Spine 4+ has more settings for smoothing:
Settings - Spine User Guide: Smoothing
By default Keep edges is checked so you get smoothing in the middle of your images, but the edges (pixels that have alpha < 1) are still drawn as pixels. Keeping the edges allows you to see exactly where your images stop while still giving you nice looking images. Uncheck Keep edges to have it show like < 4.0.
