Jump to content

PandoraSaver


ZigZagJoe

Recommended Posts

FYI: Opened the save folder to try to do a little drive management. When I did, CPU usage topped out and stayed at 100% (this often happens, as I've said. I assume it has to do with the size of that folder, as well as the sheer number of files and subfolders.) FF memory usage at 335,000 K (dropped to 220,000 as I was writing); SP at 132,000 K. At the time: PS: ripped 173; sniffed 1132.

Link to comment
Share on other sites

  • Replies 484
  • Created
  • Last Reply

Top Posters In This Topic

FYI: Opened the save folder to try to do a little drive management. When I did, CPU usage topped out and stayed at 100% (this often happens, as I've said. I assume it has to do with the size of that folder, as well as the sheer number of files and subfolders.) FF memory usage at 335,000 K (dropped to 220,000 as I was writing); SP at 132,000 K. At the time: PS: ripped 173; sniffed 1132.

Yeah, that's because explorer insists on looking through all the folders and in some cases checking all the tags. Sounds proper to me. (sproxy memory use should drop when idle as well.)

Link to comment
Share on other sites

Sounds right to me. Though, what are these empty directories you speak of? there should only be one in the zip named "Firefox-P", and then some dirs within it for firefox.

Nothing major - subfolders cuz I guess this is a whole mini-version of the browswer. Firefox-P is about 46.7 meg total with the components, dictionaries, chrome, plugins, modules, etc. folders. There are a few empty ones. A program that I use reports empty folders so that's how it came up.

So what do you suggest - at what point should we use the blacklist -or- stop using the blacklist? I've got 8,700 empty files so far in my download directory just as placeholders.

Link to comment
Share on other sites

Tips appreciated.

Like many, I have a large music directory which has become a problem owing to size and file and folder count. XP SP3 bogs down with 100% CPU use in no time, though it is irregular in exactly when it slips into this chasm it seems to always be a directory inquiry of some sort. Of course I could bust the parent directory up but not without sacrificing ease and efficacy of use. The structure is simple: music parent --> artist child --> file child: artist - album - track.mp4 (or rarely with another album directory added between artist and track file). Should the parent music folder be in its own drive partition or even separate phyical drive? How should the drive be configured? Does Vista handle this any better than XP? What can I do? The current stats, which only grow: directory size 37 GB; folder count 7200 ; file count 22,800. Tips very much appreciated as I've gotten myself into a tar pit.
Link to comment
Share on other sites

Nothing major - subfolders cuz I guess this is a whole mini-version of the browswer. Firefox-P is about 46.7 meg total with the components, dictionaries, chrome, plugins, modules, etc. folders. There are a few empty ones. A program that I use reports empty folders so that's how it came up.

So what do you suggest - at what point should we use the blacklist -or- stop using the blacklist? I've got 8,700 empty files so far in my download directory just as placeholders.

If you are moving them to another folder like you are doing I would just use the blacklist.

I posted this at http://www.annoyances.org/exec/forum/winxp, but repeat it here in case someone has some tips, and will come back with whatever I find out, if anything.

on a quick google i found this thread - http://club.cdfreaks.com/f3/explorer-exe-c...37/#post1259561

Seems similar.

Link to comment
Share on other sites

Does seem similar, but no clear resolution. I will try some possible fixes presently. Am I alone among this readership with this problem? Would anyone care to share their primary music directory structure? If I didn't care about keeping PS generated playlists or dupe checking functional, I'd be happy to bust up the directory (I've yet to implement a blacklisting scheme as my mind fogs over when I look at the how-to's).

Link to comment
Share on other sites

Anyway, thanks for the link. Very helpful in that it suggests that it is likely not related to folder size at all.

Otherwise I have had no success with possible fixes mentioned.

Do you have any of the album/artist/title etc columns enabled in explorer? Those could cause it to lag while it crawls folders, as would having it in thumbnail mode. My cpu spikes to 50% on one core for about 10 seconds when i try to load my music dir (7900 songs, 19ish gb) and then stops completely (and the folder shows up)

Link to comment
Share on other sites

Does seem similar, but no clear resolution. I will try some possible fixes presently. Am I alone among this readership with this problem? Would anyone care to share their primary music directory structure? If I didn't care about keeping PS generated playlists or dupe checking functional, I'd be happy to bust up the directory (I've yet to implement a blacklisting scheme as my mind fogs over when I look at the how-to's).

Not too long ago I was having problems with Outlook email and terribly long lag times when I'd open up Explorer. There were other problems as well and they all seemed to disappear when I turned off Windows Search 4.0.

Link to comment
Share on other sites

My PS save directory, the beast, consists soley of PS generated files. I did at the beginning try to configure the various folders to display useful info (artist, bitrate, genre, etc.) and that may be part of the problem; they are always set to display details rather than icons or thumbnails. I can't figure out now how to pare that back to the minimum for all the subfolders, as I cannot set each individually. Tools-->folder options-->view-->folder views-->apply to all?? (IMO There also should be an option there to apply to all subfolders, but there is not.)

I don't think I have any Windows Search, but the way MS sneaks crap in under there means I could be mistaken.

(One of the other culprits mentioned I do not have:

C:\Users\YOUR_NAME_HERE\AppData\Roaming\Microsoft\Windows\Network Shortcuts\)

Do you have any of the album/artist/title etc columns enabled in explorer?

Is there a way to turn these off for a folder and its subfolders?

Link to comment
Share on other sites

My PS save directory, the beast, consists soley of PS generated files. I did at the beginning try to configure the various folders to display useful info (artist, bitrate, genre, etc.) and that may be part of the problem; they are always set to display details rather than icons or thumbnails. I can't figure out now how to pare that back to the minimum for all the subfolders, as I cannot set each individually. Tools-->folder options-->view-->folder views-->apply to all?? (IMO There also should be an option there to apply to all subfolders, but there is not.)

I don't think I have any Windows Search, but the way MS sneaks crap in under there means I could be mistaken.

(One of the other culprits mentioned I do not have:

C:\Users\YOUR_NAME_HERE\AppData\Roaming\Microsoft\Windows\Network Shortcuts\)

Is there a way to turn these off for a folder and its subfolders?

Go to a folder setup how you like, then Tools->Folder Options->View and press Apply to All Folders

That should do it.

Link to comment
Share on other sites

Yeah, but of course I really just want my music folders set up like this; not my photo or text or whatever. Seems simple enough and somewhere I think there is a place where one is asked "Do you want all folders of this ilk set up like this?"

Link to comment
Share on other sites

Yeah, but of course I really just want my music folders set up like this; not my photo or text or whatever. Seems simple enough and somewhere I think there is a place where one is asked "Do you want all folders of this ilk set up like this?"

Not that i know of. Regardless, that is what causes large cpu spikes while browsing (it isn't smart enough to cache album infos once read)

Link to comment
Share on other sites

No, I did not. I don't care so much about spikes. That was not my concern. It is rather the spike becoming a flat-liner at the top of the graph - 100% CPU usage with no relief to be had, yet. Process monitor does not reveal a culprit, to me, perhaps to someone more knowledgeable, probably in the use of 'filters'. Explorer was adjusted to file name / size / date modified. Next try is along these lines:

The obnoxious bug in XP that causes Explorer to read the entire contents of broken AVI files before allowing any access to them is caused by bad behavior of shmedia.dll.

This problem manifests itself by causing Explorer to read the entire contents of an AVI file, regarless of its size or location any time the mouse pointer is hovered over it, or an attempt is made to access it in windows explorer. This causes 'permission denied' errors when trying to simply move, copy or delete these files as they cannot be changed while Explorer has an open handle on them.

This also causes a DoS situation where large AVI's are stored on remote shares and Explorer keeps reading the files from beginning to end each time they are accessed.

To correct this misbehavior in Windows XP, remove the following registry key.

HKEY_LOCAL_MACHINE\SOFTWARE\Classes\CLSID\{87D62D94-71B3-4b9a-9489-5FE6850DC73E}\InProcServer32

This will prevent Explorer from loading shmedia.dll in response to file property queries on these files. This will not effect your ability to play files, get file attributes, or even view thumbnails. Say goodbye to all explorer.exe 100% CPU issues.

And Solution #2 (basically does the same thing, except you are inactivating the file attributes option)...But it WORKS--No more locked .avi files:

Well windows seem to have a REALLY big problem when it comes to reading AVI files. It seems that when you click on an AVI file in explorer, it'll try to read the entire AVI file to determine the width,height, etc. of the AVI file (this is displayed in the Properties window). Now the problem with Windows is that if you have a broken/not fully downloaded AVI file that doesnt contain this info, Windows will scan the entire AVI file trying to figure out all these properties which in the process will probably cause 100% CPU usage and heavy memory usage.

To solve this problem all you have to do is the following:

1. Open up regedit

2. Goto HKEY_CLASSES_ROOT\SystemFileAs

sociations\.avi\shellex\PropertyHandler

3. Delete the "Default" value which should be "{87D62D94-71B3-4b9a-9489-5FE6850DC73E}"

Please note that this will no longer provide you with the windows properties displaying the AVI file information such as width, height, bitrate etc. But its a small price to pay for saving you resources.

Link to comment
Share on other sites

This is a recurring failure; XP sp3 / FF / turbo / maxi. Hope I haven't missed it's resolution.

3365917336_ddf665a792_o.jpg

Expanded:

Got song: Manta Ray - "Estratexa" on 'Estratexa'

File already exists! (J:\music - recording now - PandoraSaver\Manta Ray\Manta Ray - Estratexa - Estratexa.mp4)

Done processing song

Inspecting XML doc: http://www.pandora.com/radio/x...7561&...mp;arg5=aacplus

System.Xml.XmlException: Unexpected end of file has occurred. The following elements are not closed: methodResponse. Line 1, position 15770.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.Throw(String res, String arg)

at System.Xml.XmlTextReaderImpl.ThrowUnclosedElements()

at System.Xml.XmlTextReaderImpl.ParseEndElement()

at System.Xml.XmlTextReaderImpl.ParseElementContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.LoadNode(Boolean skipOverWhitespace)

at System.Xml.XmlLoader.LoadDocSequence(XmlDocument parentDoc)

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

Inspecting URL: http://audio-sjl-a-2.pandora.com/access/.....%2FBkYqjQ%3D%3D

Matched audio URL: http://audio-sjl-a-2.pandora.com/access/.....%2FBkYqjQ%3D%3D

Got song: Jordan Rudess - "Time Crunch" on 'Rhythm Of Time'

File already exists! (J:\music - recording now - PandoraSaver\Jordan Rudess\Jordan Rudess - Rhythm Of Time - Time Crunch.mp4)

Done processing song

Inspecting XML doc: http://www.pandora.com/radio/T...3D692109%...6arg5%3Daacplus

Inspecting XML doc: http://www.pandora.com/radio/x...7561&...mp;arg5=aacplus

Inspecting XML doc: http://www.pandora.com/radio/T...%2526arg4...rg5%253Daacplus

Inspecting XML doc: http://www.pandora.com/radio/T...3D813703%...6arg5%3Daacplus

Inspecting XML doc: http://www.pandora.com/radio/x...561&a...mp;arg5=aacplus

Inspecting XML doc: http://www.pandora.com/radio/T...rg4%25253...5%25253Daacplus

Inspecting XML doc: http://www.pandora.com/radio/T...%2526arg4...rg5%253Daacplus

System.Xml.XmlException: Root element is missing.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)

at System.Xml.XmlTextReaderImpl.ParseDocumentContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

Sniffed playlist answer

Got audio url: http://audio-sjl-a-1.pandora.com/access/.....ifGV6isjqgPDaXC

Got audio url: http://audio-sjl-a-1.pandora.com/access/.....6Edg429o6j8%2Bw

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....ioCcbxruyaM7pv3

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....Phy%2FKX6xbb%2F

System.Xml.XmlException: Root element is missing.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)

at System.Xml.XmlTextReaderImpl.ParseDocumentContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

System.Xml.XmlException: Root element is missing.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)

at System.Xml.XmlTextReaderImpl.ParseDocumentContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

Sniffed playlist answer

Got audio url: http://audio-sjl-a-1.pandora.com/access/.....w%2BG4%2F1NslvV

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....jiK9iqrQ91GbZXX

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....P1SF4AH9cdhwUVZ

Got audio url: http://audio-sjl-a-2.pandora.com/access/.....mtK5pq6DM6RqxHo

System.Xml.XmlException: Root element is missing.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)

at System.Xml.XmlTextReaderImpl.ParseDocumentContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

System.Xml.XmlException: Root element is missing.

at System.Xml.XmlTextReaderImpl.Throw(Exception e)

at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)

at System.Xml.XmlTextReaderImpl.ParseDocumentContent()

at System.Xml.XmlTextReaderImpl.Read()

at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)

at System.Xml.XmlDocument.Load(XmlReader reader)

at System.Xml.XmlDocument.Load(String filename)

at Saver.TamperResponse(Session oSession) in C:\Documents and Settings\zigzagjoe\Desktop\PandoraSaver\new\src\Saver.cs:line 736

3365917290_77dbf27de5_o.jpg

3/18/2009 3:31:16 AM GET http://www.pandora.com/xml/music/artist/ma...r=1237372276328

3/18/2009 3:31:17 AM GET http://images-sjl-2.pandora.com/images/pub...P41308VBBNO.jpg

3/18/2009 3:31:21 AM GET http://audio-sjl-a-2.pandora.com/access/?v...%2FBkYqjQ%3D%3D

3/18/2009 3:31:21 AM POST http://www.pandora.com/radio/xmlrpc/v22?ri...mp;arg5=aacplus

3/18/2009 3:31:21 AM POST 1024 bytes to www.pandora.com

3/18/2009 3:33:21 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...6arg5%3Daacplus

3/18/2009 3:35:21 AM POST http://www.pandora.com/radio/xmlrpc/v22?ri...mp;arg5=aacplus

3/18/2009 3:35:21 AM POST 1024 bytes to www.pandora.com

3/18/2009 3:37:21 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...rg5%253Daacplus

3/18/2009 3:39:21 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...6arg5%3Daacplus

3/18/2009 3:41:21 AM POST http://www.pandora.com/radio/xmlrpc/v22?ri...mp;arg5=aacplus

3/18/2009 3:41:21 AM POST 1040 bytes to www.pandora.com

3/18/2009 3:43:21 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...5%25253Daacplus

3/18/2009 3:45:21 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...rg5%253Daacplus

3/18/2009 4:28:56 AM Status: 07:11:50.5468750 running

3/18/2009 4:28:56 AM 7324 requests serviced, 8 active connections.

3/18/2009 4:28:56 AM 7.6MB sent, 5.2GB received

3/18/2009 5:30:36 AM Status: 08:13:30.2343750 running

3/18/2009 5:30:36 AM 7324 requests serviced, 8 active connections.

3/18/2009 5:30:36 AM 7.6MB sent, 5.2GB received

3/18/2009 6:32:17 AM Status: 09:15:11.7031250 running

3/18/2009 6:32:17 AM 7324 requests serviced, 8 active connections.

3/18/2009 6:32:17 AM 7.6MB sent, 5.2GB received

3/18/2009 7:33:57 AM Status: 10:16:51.7187500 running

3/18/2009 7:33:57 AM 7324 requests serviced, 8 active connections.

3/18/2009 7:33:57 AM 7.6MB sent, 5.2GB received

3/18/2009 8:35:40 AM Status: 11:18:34.5312500 running

3/18/2009 8:35:40 AM 7324 requests serviced, 8 active connections.

3/18/2009 8:35:40 AM 7.6MB sent, 5.2GB received

3/18/2009 9:14:42 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...6arg5%3Daacplus

3/18/2009 9:14:42 AM POST http://www.pandora.com/radio/xmlrpc/v22?ri...mp;arg5=aacplus

3/18/2009 9:14:42 AM POST 1040 bytes to www.pandora.com

3/18/2009 9:14:42 AM GET http://www.pandora.com/

3/18/2009 9:14:43 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...2525253Daacplus

3/18/2009 9:14:43 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...5%25253Daacplus

3/18/2009 9:14:43 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...rg5%253Daacplus

3/18/2009 9:14:43 AM GET http://www.pandora.com/radio/TUNER_WARN/v1...6arg5%3Daacplus

3/18/2009 9:14:44 AM POST http://www.pandora.com/radio/xmlrpc/v22?ri...mp;arg5=aacplus

3/18/2009 9:14:44 AM POST 1040 bytes to www.pandora.com

Link to comment
Share on other sites

looks like the first one pandora truncated the response. and the secondary failures are caused by the tuner warnings containing the same key (i've made the new version echo out arguments when a tuner warning comes - which stops this madness)

I'll try to release soon

Link to comment
Share on other sites

I can't even get the program to run =(. When I try running SProxy, I get an error message:

SProxy.exe - Application Error

The application failed to initialize properly (0x0000135). Click on OK

Just for reference, I was getting a similar error when trying to run fiddler2 for versions 1.005 and .007 as well.

Link to comment
Share on other sites

I can't even get the program to run =(. When I try running SProxy, I get an error message:

SProxy.exe - Application Error

The application failed to initialize properly (0x0000135). Click on OK

Just for reference, I was getting a similar error when trying to run fiddler2 for versions 1.005 and .007 as well.

Make sure you have the .net framework installed. Also, what OS are you using?

I've had this when testing on a friend's 64bit vista machine and was not able to resolve it. (yet mine is a 64bit xp machine and all is fine)

Link to comment
Share on other sites

...It is rather the spike becoming a flat-liner at the top of the graph - 100% CPU usage with no relief to be had, yet. Process monitor does not reveal a culprit, to me, perhaps to someone more knowledgeable, probably in the use of 'filters'. Explorer was adjusted to file name / size / date modified...

Do you have a lot of AVI files in that same directory?

My laptop was (after 5 years) starting to slow down (running XP Home). My desktop (XP Pro) and laptop were running Nortons AV Corporate. Laptop was used for more open searching and unsafe practices like youtube, unprotected pop-ups, etc. And then it started the 100% CPU with constant HDD light on. I eventually opted to download AVG (free version) and run it. Hundreds of hits from malware, spyware, etc. were found and removed. My HDD started working normal again.

FYI I decided to go through a Vista change because I needed to start getting familiar with Vista since I support PCs currently running XP and 2000. I'm using AVG (free) only on this notebook now and things have been running pretty smoothly. Over a few months it did have 100% CPU periods with HDD constant, so I disabled some WMP Shell options and removed Windows Search 4.0 and haven't had 100% CPU problems as of late.

Link to comment
Share on other sites

Make sure you have the .net framework installed. Also, what OS are you using?

I've had this when testing on a friend's 64bit vista machine and was not able to resolve it. (yet mine is a 64bit xp machine and all is fine)

Ah -_-. Leave it to me--I didn't have the framework. I'm using XP Professional vers 2002 sp3

Thanks

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    • No registered users viewing this page.

×
×
  • Create New...