If you want to check out the differences in the drum tracks, compare the original stereo mix (or the Canadian or French mono mixes, though they're not so clear) with any of the other stereo mixes. There are noticeable differences in the drum patterns played at several places in the song, including those where Dylan sings "It was then . . .", "So I forced . . ." and "Her Jamaican rum . . .".

Regarding the inseparability of the original organ and drums, we can deduce what instruments were grouped together on the four recording tracks by listening to the way the instruments have moved around between different stereo mixes: 

Original stereo mix (as on original US stereo album):

Left

Centre

Right

Acoustic Guitar
+
Bass

Vocal
+
Harmonica
+
Spanish guitars

Original Drums
+
Organ


Later stereo mixes (as on later vinyl albums and all CDs):

Left

Centre

Right

Spanish guitars

Vocal
+
Harmonica
+
Acoustic Guitar
+
Bass

Overdubbed Drums

We know from Michael Krogsgaard's research that the original recordings were made on four-track equipment, so we can now work out how the instruments must have been assigned to the tracks on the tape at the original recording session. This shows the inevitable problem in getting rid of the organ:

Four-track master:

Track 1

Track 2

Track 3

Track 4

Vocal
+
Harmonica

Acoustic guitar
+
Bass

Spanish guitars

Original Drums
+
Organ