|
| |||||
Jazz Guitar Scales  Jazz Piano Chords and Scales | BebopBot- Crawler Information -Greetings - If you're reading this, chances are you've seen our robot visiting your site while looking through your server logs. BebopBot is a linear web crawler owned & operated by A Passion for Jazz! as part of an ongoing effort to develop a niche based searchable Web index. We are not attempting to steal any copyrighted information from your site & will not be re-distributing your content. We will only be allowing users to find your website more easily. The information gathered is being indexed & made accessible via one or more publicly accessible web sites. We don't currently accept URL submissions. We discover and add new sites to our index by link-crawling. Basically you just need to make sure that you allow BebopBot to crawl your site, and then we will need to discover it via links from other sites. You can control access to your site by updating your robots.txt file. Our software follows W3C standards & supports robots.txt files & robot META tags in HTML. These are the standard mechanisms for webmasters to tell web robots which portions of a site a robot is welcome to access. To prohibit BebopBot from indexing any web pages on your site: User-agent: BebopBot Disallow: /
BebopBot from any other IP address is a hoax & not us. We intend for our robot to be a polite & unobtrusive netizen & apologize for any bad behavior while visiting your site. To save bandwidth, BebopBot may keep robots.txt file for up to 24 hours after downloading, so it may take a while to learn of any changes. We strongly support the rights of our fellow webmasters & value your input. To contact the administrator, send email to: |
 |  |
