PandoraSaver

ZigZagJoe · February 23, 2009

I put that at the end of my post - I'll grovel to a mod sometime and see if i can't get the threads sorted (and the title changed on this one, when ready).

Got the blacklisting stuff implemented; just need to do final testing.

Note to self: Hotspotshield uses a HTTP proxy. So I guess i should implement http proxy chaining after all (hotspotshield being a free anonomizer vpn dealie that also allows pandora to work, much like Tor)

Is anyone running this on a vista machine? I just tried it on a friend's comp and received a cryptic (read: nonsensical) error :X and would like to know if it is a machine-specific problem or all around vista.

After figuring the vista situation out, and doing a little bit of testing on other machines i'm more or less ready to call the standalone SProxy version ready for proper release and the fiddler version officially obsolete.

boem · February 23, 2009

As for no music played, you might try firefox, and see if that works. Playing no music while displaying "It's taking longer..." while happily ripping away seems to be an IE-specific problem. I haven't the faintest what would cause that problem, though. If you can, PM me the results of http://127.0.0.1:8888/config on the newest beta version

No it's not IE-specific. Firefox behaves exactly the same. I know that if the pac file below is used it will play but no proxy chaining and hence no ripping.

function FindProxyForURL(url, host)
{

if (shExpMatch(host, "*pandora.com*")) return "SOCKS 127.0.0.1:9050";

// All other requests don't pass proxy

return "DIRECT";

}

That make me think if there is a way to do proxy chaining with the above pac config.

Lastly http://127.0.0.1 returns

502 Server Error
Connection failure

--------------------------------------------------------------------------------

Timed out waiting for a response

ZigZagJoe · February 23, 2009

Have you tried putting 127.0.0.1:8888 as a nonspecific proxy server, that is, use it all the time? Also, are you seeing the various requests being routed through SProxy? (they will show in the main window and log)

for the PAC files, you would use return "PROXY 127.0.0.1:8888" instead of socks (wind up with the same PAC i had in the first post) to have it route through SProxy and PS.

And yeah, i noticed that i had firefox set to send local requests through proxy too, hence that worked for me. Oops.

boem · February 24, 2009

Have you tried putting 127.0.0.1:8888 as a nonspecific proxy server, that is, use it all the time? Also, are you seeing the various requests being routed through SProxy? (they will show in the main window and log)

With nonspecific proxy server I still got Error 502 but this time with a different description: "Unable to connect: DNS resolution failed." Yes all the requests are shown in SProxy.

ZigZagJoe · February 24, 2009

With nonspecific proxy server I still got Error 502 but this time with a different description: "Unable to connect: DNS resolution failed." Yes all the requests are shown in SProxy.

Hmmmm, something is very wrong if it can't resolve DNS. What is your internet setup like? do you connect through a proxy normally, nevermind for pandora?

boem · February 24, 2009

Hmmmm, something is very wrong if it can't resolve DNS. What is your internet setup like? do you connect through a proxy normally, nevermind for pandora?

I normally connect to the Internet directly with no proxy. I only use proxy with Pandora.

Edit

http://127.0.0.1:8888 is working in Firefox (without pac file). But still with "It's taking longer.." error.

Stokastik · February 24, 2009

The beta version, located at http://zzj.itf-inc.com/SP1.0bPS1.006BETA.zip has been updated to the most recent version.

Thanks. I am not able not to test it since TOR is not running for me: more precisely, none of the US exitnodes seems to work anymore :-(

Stokastik · February 24, 2009

Now TOR is working. I have problems with SP: it seems that "turbo mode" is alwas on, since it is always trying to get multiple audio at the same time (I see from the log), so when Pandorasaver is on it never plays the music. Even if you uncheck the option it is still in turbo mode, and the same message "it's taking longer than expected..." comes out

If simpleproxy is running but Pandorasaver is disabled the music plays correctly other

Also: it frequently goes on timeout. keep in mind that using TOR the actual speed of transfer is about 10 kb/s so the program should be more patient when receiving the data :-)

ZigZagJoe · February 24, 2009

Now TOR is working. I have problems with SP: it seems that "turbo mode" is alwas on, since it is always trying to get multiple audio at the same time (I see from the log), so when Pandorasaver is on it never plays the music. Even if you uncheck the option it is still in turbo mode, and the same message "it's taking longer than expected..." comes out
If simpleproxy is running but Pandorasaver is disabled the music plays correctly other

Also: it frequently goes on timeout. keep in mind that using TOR the actual speed of transfer is about 10 kb/s so the program should be more patient when receiving the data :-)

Actually, the multiple requests is caused by the flash applet being impatient. It might be timing out itself. I'll look into seeing if i can get it to stop doing that (i notice it sometimes even though it downloads very fast here)

Turbo mode doesn't actually change how it downloads, it just changes it so when a song is completely downloaded and is about to be sent to the flash applet it swaps the song data with a 5 second long blank aac file. I'll look into getting HTTP proxy chaining again, as it seems "Hotspotshield" is much faster than TOR and provides the same function (fooling pandora).

@boem:

I'll try implementing some DNS backups (specifically, the ability to look up dns via socks4a/tor) for lack of a better idea.

I'll upload the newest (still-beta) version in a bit once i've made some changes.

Stokastik · February 24, 2009

when a song is completely downloaded and is about to be sent to the flash applet it swaps the song data with a 5 second long blank aac file.

But I saw 3 and even 4 songs downloading at the same time, and no song actually played (always the same annoying message). However if i disable pandorasaver the songs are played normally, one at a time

Hope it helps to figure it out what's happening.

ZigZagJoe · February 24, 2009

But I saw 3 and even 4 songs downloading at the same time, and no song actually played (always the same annoying message). However if i disable pandorasaver the songs are played normally, one at a time
Hope it helps to figure it out what's happening.

If you can get the log it would help a lot. (see this diagram: http://i141.photobucket.com/albums/r49/zigzagjoe/sptut.gif )

A screen of SProxy's main window + a log exerpt would be good as well. (at the time you are trying to load pandora)

JazzMaster · February 24, 2009

Great Job! I really love this thing.

Every version just gets better and I am very grateful. But one aspect of every version just doesn't seem to work for me. The log file indicates the successful execution of mp4tags.exe, but the Save Folder tells a different story. Folders are named properly as are files - without any tags. Is anyone else having this problem

ZigZagJoe · February 24, 2009

Great Job! I really love this thing.
Every version just gets better and I am very grateful. But one aspect of every version just doesn't seem to work for me. The log file indicates the successful execution of mp4tags.exe, but the Save Folder tells a different story. Folders are named properly as are files - without any tags. Is anyone else having this problem

What player are you using? If you are using WMP to play, it does not have built in support for reading AAC tags (and will show nothing).

JazzMaster · February 25, 2009

What player are you using? If you are using WMP to play, it does not have built in support for reading AAC tags (and will show nothing).

Just added AudioShell to allow Windows Explorer to see the tags. It's ALL good now. Thanks.

yeehaa · February 25, 2009

I'll upload the newest (still-beta) version in a bit once i've made some changes.

thanks! will be waiting for that!

ZigZagJoe · February 25, 2009

@boem+Stokastik:

i've added support for proxy dns resolving (to allow tor to handle resolving of the addr).

Also, i tested "hinting" (basically dropping the first line immediately to try to stop it from requesting more) and it did not stop pandora from complaining.

I'm thinking I will need to introduce a low bandwidth mode in which it streams all data to prevent this. (this will disable turbo mode, but Tor could hardly support that anyways). Edit: low bandwidth mode does indeed fix it. However, the download button, auto refresh, miniplayer check-breaking, and ad removal options are all disabled. (because the response is immediately written to the server, can't change what is already sent!)

after messing with tor, i've got the timeout sorted by drastically increasing the timeout. (these are also able to be edited in the config file - defaults to 60secs)

note to self: blacklist deletion. After that's done and tested working can probably release.

Edit. Tried hotspot shield. It can successfully chain, yes, but it doesn't allow the CONNECT method. Thus, Pandora can't load via it. HTTP proxy chaining is completed regardless.

ZigZagJoe · February 25, 2009

Standalone version released! download it at http:// zzj.itf-inc.com/SPPS1.000c.zip (OUTDATED)

Huzzah~

New features of note:

Blacklisting! prevent files from being downloaded + delete already existing

Standalone and such. No external programs required.

Low bandwidth mode, for tor and slower connections. Use this if Pandora requests songs multiple times, or if you know your connection speed to be lower than 50kb/s.

Bugfixes up the arse (of course.)

I'll update the graphic in a bit.

Now i just need to find me a moderator to sort the title (now fiddler-free)

With this, the fiddler version is tentatively obsoleted and discouraged from active use (I'd rather not have to backport everything, even when they are rather similar)

Hawaii Guy · February 25, 2009

I'll update the graphic in a bit.

Hey ZZJ - not sure what graphic you are referring to, but can you check the album artwork that's being saved ... I noticed you are caching it but where too? I noticed a bunch of files I grabbed the other day all have the same artwork but are all wrong.

Thx!

ZigZagJoe · February 25, 2009

I'll update the graphic in a bit.
Hey ZZJ - not sure what graphic you are referring to, but can you check the album artwork that's being saved ... I noticed you are caching it but where too? I noticed a bunch of files I grabbed the other day all have the same artwork but are all wrong.

Thx!

By graphic i meant the large image showing where stuff is.

Just checked the album art, and it was all correct.

The caching is just to memory - it saves the image that Pandora got and the URL that got it. Then, if a song played has the same album art URL as one that is stored in the cache it uses the cached image rather than re-download it (which would be traceable).

Hawaii Guy · February 25, 2009

Came across this - never saw it before:

Inspecting URL: http://audio-sjl-a-1.pandora.com/access/.....DuBi9n4ykuvew7y

Matched audio URL: http://audio-sjl-a-1.pandora.com/access/.....DuBi9n4ykuvew7y

Cached albumArt: http://images-sjl-4.pandora.com/images/pub...0_130W_130H.jpg

Got song: Dan Fogelberg - "Heart Hotels" on 'Phoenix'

File already exists! (\Dan Fogelberg - Heart Hotels.m4a)

Inspecting XML doc: http://www.pandora.com/radio/x...3=6454188...mp;arg6=aacplus

Sniffed playlist answer

Got audio url: http://audio-sjl-t2-1.pandora.com/access/....dOhrWvXnMDjnRCA

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....fXwoF7j5nv%2Fax

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....G9czFj8GeEc6o5M

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....tc4WWskDD8VRAzl

Inspecting URL: http://audio-sjl-a-2.pandora.com/access/.....Vgjzoopd4loU%3D

Matched audio URL: http://audio-sjl-a-2.pandora.com/access/.....Vgjzoopd4loU%3D

Got song: The Aerovons - "With Her" on 'Resurrection'

File already exists! (\The Aerovons - With Her.m4a)

Inspecting URL: http://audio-sjl-t2-1.pandora.com/access/....dLGjn5z9Vo1nkC4

Matched audio URL: http://audio-sjl-t2-1.pandora.com/access/....dLGjn5z9Vo1nkC4

Inspecting URL: http://audio-sjl-a-2.pandora.com/access/.....fz5Y41eQg%3D%3D

Matched audio URL: http://audio-sjl-a-2.pandora.com/access/.....fz5Y41eQg%3D%3D

Data length too short! (347)

0000 3C 21 44 4F 43 54 59 50 45 20 48 54 4D 4C 20 50 <!DOCTYPE HTML P

0010 55 42 4C 49 43 20 22 2D 2F 2F 49 45 54 46 2F 2F UBLIC "-//IETF//

0020 44 54 44 20 48 54 4D 4C 20 32 2E 30 2F 2F 45 4E DTD HTML 2.0//EN

0030 22 3E 0A 3C 68 74 6D 6C 3E 3C 68 65 61 64 3E 0A ">.<html><head>.

0040 3C 74 69 74 6C 65 3E 34 30 30 20 42 61 64 20 52 <title>400 Bad R

0050 65 71 75 65 73 74 3C 2F 74 69 74 6C 65 3E 0A 3C equest</title>.<

0060 2F 68 65 61 64 3E 3C 62 6F 64 79 3E 0A 3C 68 31 /head><body>.<h1

0070 3E 42 61 64 20 52 65 71 75 65 73 74 3C 2F 68 31 >Bad Request</h1

0080 3E 0A 3C 70 3E 59 6F 75 72 20 62 72 6F 77 73 65 >.<p>Your browse

0090 72 20 73 65 6E 74 20 61 20 72 65 71 75 65 73 74 r sent a request

00A0 20 74 68 61 74 20 74 68 69 73 20 73 65 72 76 65 that this serve

00B0 72 20 63 6F 75 6C 64 20 6E 6F 74 20 75 6E 64 65 r could not unde

00C0 72 73 74 61 6E 64 2E 3C 62 72 20 2F 3E 0A 3C 2F rstand.<br />.</

00D0 70 3E 0A 3C 70 3E 41 64 64 69 74 69 6F 6E 61 6C p>.<p>Additional

00E0 6C 79 2C 20 61 20 34 30 30 20 42 61 64 20 52 65 ly, a 400 Bad Re

00F0 71 75 65 73 74 0A 65 72 72 6F 72 20 77 61 73 20 quest.error was

0100 65 6E 63 6F 75 6E 74 65 72 65 64 20 77 68 69 6C encountered whil

0110 65 20 74 72 79 69 6E 67 20 74 6F 20 75 73 65 20 e trying to use

0120 61 6E 20 45 72 72 6F 72 44 6F 63 75 6D 65 6E 74 an ErrorDocument

0130 20 74 6F 20 68 61 6E 64 6C 65 20 74 68 65 20 72 to handle the r

0140 65 71 75 65 73 74 2E 3C 2F 70 3E 0A 3C 2F 62 6F equest.</p>.</bo

0150 64 79 3E 3C 2F 68 74 6D 6C 3E 0A dy></html>.

Got song: The Monkees - "A Little Bit Me, A Little Bit You" on 'Greatest Hits'

File already exists! (\The Monkees - A Little Bit Me, A Little Bit You.m4a)

Inspecting URL: http://audio-sjl-a-2.pandora.com/access/.....fx8n92u5w%3D%3D

Matched audio URL: http://audio-sjl-a-2.pandora.com/access/.....fx8n92u5w%3D%3D