Thread
:
Robot.txt Question
View Single Post
03-30-2007, 03:51 AM
#
2
(
permalink
)
Dharma
Family Member
Join Date: Nov 2006
Location: NM, USA
Posts: 1,394
Is the "garbage" the HTML? It's seeing your page like your web browser sees it. It doesn't need it to look pretty because it's not a human reading the page. The spider will parse you page based on the tags.
Dharma
View Public Profile
Visit Dharma's homepage!
Find More Posts by Dharma