After watching the episode where the Zipit was modified, I saw the Cherrypal Africa $99 laptop online and thought it may be a nice inexpensive device to mod.
It has a 400MHz processor, 256MB of RAM and a 7" screen and runs Linux or Windows CE.
Here is a link to the product page: Cherrypal Product Page