Its kinda funny to think about defenses when we're talking about physical access to something.
I mean once you have physical access to a computer...GAME OVER. Sure its nice that ducky can do things super fast but in a couple minutes, anything can be done to a computer.
So just put your computer in a giant safe and lock it before you leave ;)
of course if someone can open the safe...