Jump to content

PandoraSaver


ZigZagJoe

Recommended Posts

QUOTE (brofix @ Fri, 27 Feb 2009 23:48:21 +0000) *

Reload every 30 mins not preventing Pandora 'Are you?' stoppage. XP, firefox, full player, turbo.

Check for a line similar to "<meta http-equiv="refresh" content="3600">" in the source. it may be 3600, 1800, or some other value depending on interval. Also, when you load pandora, it should say auto-mangling page .... in Pandorasaver's log.

Sorry, where do I check for the line "<meta http-equiv="refresh" content="3600">"?

I see no "auto-mangling page" in Pandorasaver's log. Here's the log when I start Pandora, but not with a fresh start of PS):

Inspecting XML doc: http://www.pandora.com/radio/xmlrpc/v21?ri...amp;method=sync

Inspecting XML doc: http://www.pandora.com/radio/xmlrpc/v21?ri...hod=getStations

Sniffed station query

Inspecting XML doc: http://www.pandora.com/radio/x...arg3=4395...mp;arg6=aacplus

Sniffed playlist answer

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....eBt8N1xTMg7tgdp

Got audio url: http://audio-sjl-a-1.pandora.com/access/.....NeXAyZu2X8%2FG9

Got audio url: http://audio-sjl-a-1.pandora.com/access/.....ke2OIsFk0ZHLr%2

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....sfWdnpG11IpFP3%

Inspecting URL: http://audio-sjl-a-2.pandora.com/access/.....heSVUvpxoCPE%3D

Matched audio URL: http://audio-sjl-a-2.pandora.com/access/.....heSVUvpxoCPE%3D

Cached albumArt: http://images-sjl-4.pandora.com/images/pub...3_130W_130H.jpg

Cached albumArt: http://images-sjl-4.pandora.com/images/pub...P67460OT5QY.jpg

Got song: The Bennie Maupin Quartet - "Black Ice" on 'Early Reflections'

Saving mp4 file (1519346 bytes) to J:\music - recording now - PandoraSaver\The Bennie Maupin Quartet\Early Reflections\The Bennie Maupin Quartet - Early Reflections - Black Ice.mp4

Using cached data with size {Width=130, Height=130} : http://images.../3/2/7/3/671860013723_130W_130H.jpg

Tagging mp4 file.

Running mp4tags.exe "J:\music - recording now - PandoraSaver\The Bennie Maupin Quartet\Early Reflections\The Bennie Maupin Quartet - Early Reflections - Black Ice.mp4" -A "Early Reflections" -a "The Bennie Maupin Quartet" -s "Black Ice" -g "Jazz " -w "SID: 'Led Bib Radio'" -c "Ripped by PandoraSaver [Z]" -P "J:\music - recording now - PandoraSaver\The Bennie Maupin Quartet\Early Reflections\album.png"

Done processing song

Inspecting URL: http://audio-sjl-a-1.pandora.com/access/.....8M3%2B8BCxxg%3D

Matched audio URL: http://audio-sjl-a-1.pandora.com/access/.....8M3%2B8BCxxg%3D

Link to comment
Share on other sites

  • Replies 484
  • Created
  • Last Reply

Top Posters In This Topic

It would be the in the source of the webpage; but, as there is no auto-mangling page in the log, it's obviously not getting written. Is low bandwidth mode enabled? That's the only reason it would not automatically make the changes, or if you are using an odd URL to access Pandora (IE. not http://www.pandora.com or http://pandora.com, and not using the miniplayer)

Also, good, those logs gave me a good idea of what went wrong: the paths are too long. Copy and paste your save folder address here (C:\Documents.. or whatever.) so i can confirm it. A low of windows functions have a 255 char path length limit, a holdover from Dos-based windowses, even though NTFS support 4096. It seems that it was butting into that.

What i do if i dont rip, just listen:

I have a whitelist in foxyproxy for *.pandora.com*

Then i have blacklisted:

*.swf*

*image*

*audio*

The result is that any blacklisted items are transfered directly and just the ones which are on the whitelist and not on blacklist will be transfered via TOR network

So after an hour of listening i only load 2 megabytes on TOR

works great, and it would be even greater if you find a way to make this work with sproxy :)

Because it seems like TOR causes a lot of problems when ripping, i have a lot of delay and connection problems, but it still works most of the time :)

Hmm. I see. The blacklist i've implemented will be able to handle that, though the SWF file will probably have to be downloaded via Tor; Sproxy does not meddle with the SSL connection used to download it. Might or might not get that to work. Still, it would be a great improvement for sure (I tried listening via tor a few times for sake of testing....it did work, but god damn if it wasn't slow to load initially)

Link to comment
Share on other sites

Is low bandwidth mode enabled? That's the only reason it would not automatically make the changes, or if you are using an odd URL to access Pandora (IE. not http://www.pandora.com or http://pandora.com, and not using the miniplayer)

Low bandwidth definitely not enabled explicitly; also using turbo.

Pandora access via 'http://www.pandora.com/?cmd=tuner.'

I'll try 'http://www.pandora.com.'

Link to comment
Share on other sites

Also, good, those logs gave me a good idea of what went wrong: the paths are too long. Copy and paste your save folder address here (C:\Documents.. or whatever.) so i can confirm it. A low of windows functions have a 255 char path length limit, a holdover from Dos-based windowses, even though NTFS support 4096. It seems that it was butting into that.

Well, I know not the helpfulness of this (I redid this since I don't know where the first one went):

sproxy fails.evtx

The event viewer log:

Log Name: Application

Source: Windows Error Reporting

Date: 2/27/2009 10:16:27 PM

Link to comment
Share on other sites

RE: recording quality

There are no known quality enhancements to be made to these processes. In other words the result is as good as the stream itself or it is indiscernibly different from it? (Remember: I already admitted to being ignorant.)

Yes - the data saved as mp4 files is the same data that Pandora plays. Can't get any better. However, the quality selected if you are using trancoding will affect the quality to some degree.

Hmm, doesn't look like that save path is too long. Do you have a log of PS when it happened?

Development note. Got Exemptions working properly: there is now the option to only send pandora control URLs through SProxy's configured proxy. This may obsolete low bandwidth mode; however that will stay for sake of compatibility.

Link to comment
Share on other sites

Hi !

Thanks for your asome work!

but i have a problem, about 30 percent of the mp3s have massive clipping, others have cristal clear sound

is there a way to set a parameter for the mp3 encoding for normalize the mp3s

and, can i remove the clipping anyhow without quality loss ?

Thanks, have a goot day

Dr.

Link to comment
Share on other sites

No, because the log is scrapped when the failure occurs, or seems to be. I'll watch out for it, though.

PandoraSaver->Settings->Advanced->Start logging (it will change to stop logging once pressed)

Then look for log.txt in the save folder.

Hi !

Thanks for your asome work!

but i have a problem, about 30 percent of the mp3s have massive clipping, others have cristal clear sound

is there a way to set a parameter for the mp3 encoding for normalize the mp3s

and, can i remove the clipping anyhow without quality loss ?

Thanks, have a goot day

Dr.

Clipping? What do you mean? Too short? or is the volume wrong? As for LAME settings; you are on your own as i have not used lame outside of a few tests. I haven't the faintest what its other options are.

Misc note: Think i found the reason why tons of memory could be used but all of it was unaccounted for. Was an "optimization". Supposedly.

Link to comment
Share on other sites

the baseline sound overmodulated, its a volume level thing

here a wavelin picture of clipping

http://noiasca.rothschopf.net/deutsch/stoe..._clipping_2.jpg

ok try to find infos elswheren, but thanks

try putting "--replaygain-accurate" into the encoder command line on advanced options. (only thing i really found)

reconfirm: On the Vista machine, PS starts but does nothing when the maxi player runs and turbo is on or off.

It works fine with the mini in turbo and not inturbo.

I hope to get a log up after next SP failure.

I'm not quite sure what you are saying (outside of something is not working). Are you seeing pandora requests in SProxy's window? (stuff like CONNECT www.pandora.com, GET http://audio-*.pandora.com/, and so on)

Link to comment
Share on other sites

No news likely. The first hiccup like this:

Proxy Server Refused Connection

Firefox is configured to use a proxy server that is refusing connections.

The browser is configured to use a proxy server, but the proxy refused a connection.

* Is the browser's proxy configuration correct? Check the settings and try again.

* Does the proxy service allow connections from this network?

* Still having trouble? Consult your network administrator or Internet provider for assistance.

Link to comment
Share on other sites

No news likely:

Can you bring up the mini-site ( http://127.0.0.1:8888/ ) in your browser? If not, something is evidently using the same port as SProxy (however, you should get a message to that effect when you try to launch it). If you can bring it up, but not other sites, verify that you have the details in correctly.

You also might check if there is a "ghost" sproxy running (that is, a hung process with no window).

If it doesn't come up, check the listen port setting in SProxy config (under minimize to tray).

Link to comment
Share on other sites

So when Sproxy fails during an unattended turbo session, it may leave behind a considerable number of unnamed mp4s in the form of temp.dat files. This seems odd since it seems to take care of naming them more or less in line.

Link to comment
Share on other sites

So when Sproxy fails during an unattended turbo session, it may leave behind a considerable number of unnamed mp4s in the form of temp.dat files. This seems odd since it seems to take care of naming them more or less in line.

Actually, it's the pandorasaver module that is failing, not SProxy. How many temp.dat files were there, exactly?

I think what might be happening is somewhere in the worker thread something hairballs and throws that error you saw, but as the tamper method did not throw the error sproxy goes happily on with pandora. But, the temp files never get processed or reaped when there is too many, hence that...

Atleast i have an idea what is going wrong; Something in the worker thread is throwing an IOException, in the outermost try-catch (which re-throws errors after logging them). If you can get a log it would help a lot.

Link to comment
Share on other sites

How many temp.dat files were there, exactly?

44 over the course of 6-7 minutes, this time on the XP machine.

Below is the log for the stretch, from just before it started creating dats instead of mp4s to the time of creating dats.

2/28/2009 5:10:29 PM Done processing song

2/28/2009 5:10:33 PM Inspecting URL: http://audio-sjl-a-1.pandora.com/access/?v...9Q2NS2tiw%3D%3D

2/28/2009 5:10:33 PM Matched audio URL: http://audio-sjl-a-1.pandora.com/access/?v...9Q2NS2tiw%3D%3D

2/28/2009 5:10:34 PM Got song: Janacek, Leos - "String Quartet No. 2 ("Listy duverné," "Intimate Letters"), JW 7/13" on 'Hagen Quartett, Janacek: String Quartets 1 & 2; Wolf: Italian Serenade'

2/28/2009 5:10:34 PM Saving mp4 file (2601630 bytes) to J:\music - recording now - PandoraSaver\Janacek, Leos\Hagen Quartett, Janacek String Quartets 1 & 2; Wolf Italian Serenade\Janacek, Leos - Hagen Quartett, Janacek String Quartets 1 & 2; Wolf Italian Serenade - String Quartet No 2 ( Listy duverné, Inti.mp4

2/28/2009 5:10:34 PM System.IO.IOException: Cannot create a file when that file already exists.

at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)

at System.IO.__Error.WinIOError()

at System.IO.File.Move(String sourceFileName, String destFileName)

at Saver.HandlePendingSessions()

2/28/2009 5:10:40 PM Inspecting XML doc: http://www.pandora.com/radio/xmlrpc/v21?ri...mp;arg6=aacplus

2/28/2009 5:10:40 PM Sniffed playlist answer

2/28/2009 5:10:40 PM Got audio url: http://audio-sjl-t2-1.pandora.com/access/?...feSNLIK%2FKlFm5

2/28/2009 5:10:40 PM Got audio url: http://audio-sjl-a-2.pandora.com/access/?v...z98txsZ%2FrLEpA

2/28/2009 5:10:40 PM Got audio url: http://audio-sjl-a-2.pandora.com/access/?v...cg8E8OvQnQwpd%2

2/28/2009 5:10:40 PM Got audio url: http://audio-sjl-t2-2.pandora.com/access/?...QpJV%2BRlClUmYC

2/28/2009 5:10:42 PM Inspecting URL: http://audio-sjl-a-1.pandora.com/access/?v...m%2FI5h3w%3D%3D

2/28/2009 5:10:42 PM Matched audio URL: http://audio-sjl-a-1.pandora.com/access/?v...m%2FI5h3w%3D%3D

At the time of fatal failure, there is only more of the same:

2/28/2009 5:17:03 PM Cached albumArt: http://images-sjl-4.pandora.com/images/pub...0_130W_130H.jpg

2/28/2009 5:17:04 PM Cached albumArt: http://images-sjl-1.pandora.com/images/pub...P57871INXMG.jpg

2/28/2009 5:17:10 PM Inspecting URL: http://audio-sjl-a-1.pandora.com/access/?v...37KyRnScP0FyXpS

2/28/2009 5:17:10 PM Matched audio URL: http://audio-sjl-a-1.pandora.com/access/?v...37KyRnScP0FyXpS

Link to comment
Share on other sites

Aha. Got it. It truncates the length of the song name (because of filesystem stuff), but it compares against the full length names (thus they do not match). and thusly thinks they do not exist and tries to rip again. Hotfix: Enable strict duplicate checking under advanced settings.

(god DAMN that is long!)

Link to comment
Share on other sites

It truncates the length of the song name (because of filesystem stuff), but it compares against the full length names (thus they do not match). and thusly thinks they do not exist and tries to rip again. Hotfix: Enable strict duplicate checking under advanced settings.

So I helped make my problem by adding the album name to the file name, thus making it problematically long?

Link to comment
Share on other sites

QUOTE (brofix @ Sat, 28 Feb 2009 18:04:33 +0000)

reconfirm: On the Vista machine, PS starts but does nothing when the maxi player runs and turbo is on or off.

It works fine with the mini in turbo and not inturbo.

I'm not quite sure what you are saying (outside of something is not working). Are you seeing pandora requests in SProxy's window? (stuff like CONNECT www.pandora.com, GET http://audio-*.pandora.com/, and so on)

Not as I recall, none of that in maxi, only in mini.

Link to comment
Share on other sites

So I helped make my problem by adding the album name to the file name, thus making it problematically long?

Yeah, because it is also trying to organize it, too, so it included the long name twice. I'd recommend dropping %album%\ from the organization format ("Folder structure"); not much point in putting it in a folder named for the album when the album is also in the name of the file.

Link to comment
Share on other sites

Hotfix: Enable strict duplicate checking under advanced settings.

That should not slow things down one bit, should it? My perception is that I'm getting fewer saves, but that must be due to other factors, the most common being that the file already exists.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.

×
×
  • Create New...