Crawling the Web
Building a web site is easy, it is just a collection of pages, with links to each other.
Firstly you have to buy a web address, known as a domain name. I bought mine for just £3 per year. You then need to have your web site stored on a computer linked to the internet in a special way. This requires some technical knowledge so we decided to pay to use someone else’s web computer. 123-reg.co.uk proved a service which includes an instant web site building tool for £5 a month.
But just doing this is not enough for your pages to be found. The internet is very big and your site will be tiny - like a single grain of sand on a beach.
Search engines (like Google) use small programs to crawl the web. These programs are called spiders - lol. The spiders look for sites and read them to see what they are about and then record details about them.
When someone uses the search engine to look for something the search engine checks what it has found and gives you a list of possible sites. The trick is to make your site appear top of the list.
The first thing to do is tell the search engine about your site and they will send a spider to visit it. You need to use some key words and make sure these are on your site. My keywords are the two spellings Le Plastrier and Leplastrier.
Today (15 May 2007) a search for Leplastrier on Google.co.uk has my site TOP for UK sites but only 9th world wide. Le Plastrier was better being top on UK and 3rd World wide. There were 548 UK pages for Leplastrier - so coming TOP was great. Worldwide 13,900 pages were found, so 9th was very good.
Daddy says it changes from week to week, and the other week I was not even on the first page of results. The spiders keep coming back and if nothing has changed since their last visit they get bored. We made some changes to the site last week and the spiders like that.