Based off an internal e-mail about search engine optimization strategy:

When you start determining the SEO strategy for your site, the first instinct might be to try and figure out how search engine bots think and act and go from there, but that’s only half the battle. It doesn’t really matter if you know how a bot interacts with the web if you also don’t think about how it sees the web. So, what follows is a little thing I like to call “SEO and Your Grandma”.

Something that you need to understand about bots is… they’re dumb. Okay, maybe that’s a bit harsh. It’s more that bots don’t comprehend as much as a regular web browser. Since what they’re really concerned about is text and links, that’s how most of them see the world. They can’t parse what’s in images (only what they link to) and they don’t really care about new-fangled things like CSS (first working draft published in 1996) and JavaScript (first implemented in 1995). They’re sort of like your grandmother in that sense, and not the cool one who listens to Coldplay and tells dirty jokes. They’re more like the traditional granny that sees the world simply, doesn’t really keep up with the latest trends, and if they encounter something they’re not familiar with, they just ignore it, or even forget about it altogether and head back home. Therefore, if we want granny to pay attention to something, we have to try and see how granny sees.

So, how do we do that? Easy–turn off CSS, JavaScript, and images. Yes, it can be done. There are prefs to disable all three in every major browser, but if you want to do it much more easily in Firefox, check out Chris Pedrick’s Web Developer extension. You’ll have a nifty new toolbar that will let you turn off images, JavaScript, and CSS in a couple clicks each, and you’ll also have a bunch of new tools that let you handle cookies, window sizing, validation, and some other stuff you’ll find fun (if you’re a front-end web developer). If you’re really hardcore, though, you can try looking at pages in just a text-based browser. There’s Lynxlet for OS X, some Lynx ports for Win32, and I’m sure most of you *nix people already know what to do. ;) After trying to browse for a few minutes with those, you’ll have a new understanding of the word “tedium,” but on the plus side, you’ll have one app that instantly puts you in bot mode.

And that’s all there is to it: just a small install and you’re ready to go. If you start making sure to give your public pages a quick look with your granny goggles before letting them loose, you’ll be able to eliminate a lot of potential SEO problems. Looking at pages this way can also help you figure out where you can make improvements, since you’ll be seeing things more from a bot’s perspective. At the very least, it’ll help put you in the correct mindset for SEO, and you can start building from there.

Tony Changho :: Dec.04.2008
Angel Group Manager, Entrepreneur, Startup, Technology, VC