localendar.com
robots.txt
Robots Exclusion Standard data for localendar.com
Resource Scan
Scan Details
| Site Domain | localendar.com |
| Base Domain | localendar.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T05:47:56+00:00 |
| Next Scan | 2024-10-01T05:47:56+00:00 |
Last Scan
| Scanned | 2024-09-24T05:47:56+00:00 |
| URL | https://localendar.com/robots.txt |
| Domain IPs | 72.167.135.25 |
| Response IP | 72.167.135.25 |
| Found | Yes |
| Hash | b4c89c40e79a376b56943e3351d85c3c867c1a6cf8545c4915a82cd109d5d09a |
| SimHash | 5488c0414072 |
Groups
sogou spider
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
| Product | Comment |
|---|---|
| sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
| Rule | Path |
|---|---|
| Disallow | / |
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yahoo! slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*fuck |
| Disallow | /*-nude |
| Disallow | /*nude- |
| Disallow | /*-xxx |
| Disallow | /*xxx- |
| Disallow | /*young- |
| Disallow | /*-sex |
| Disallow | /*sex- |
| Disallow | /*-tits |
| Disallow | /*incest |
| Disallow | /*-cunt |
| Disallow | /*-cock |
| Disallow | /*pussy |
| Disallow | /*-dick- |
| Disallow | /*-porn |
| Disallow | /*-penis |
| Disallow | /*.pl |
| Disallow | /*.php |
| Disallow | /*-orgy |
| Disallow | /*order- |
| Disallow | /*huge- |
| Disallow | /*rape- |
| Disallow | /*-ass |
| Disallow | /*teen- |
| Disallow | /*sexy- |
| Disallow | /*boob- |
| Disallow | /*gay- |
| Disallow | /*dirty- |
| Disallow | /*cute- |
| Disallow | /*giant- |
| Disallow | /*pregnant- |
| Disallow | /*girl- |
| Disallow | /*girls- |
| Disallow | /*hentai- |
| Disallow | /*hardcore |
| Disallow | /*hetero- |
| Disallow | /*horny- |
| Disallow | /*horse- |
| Disallow | /*hot- |
| Disallow | /*lesbian- |
| Disallow | /*mature- |
| Disallow | /*naked- |
| Disallow | /*black- |
| Disallow | /*pussy |
| Disallow | /*adult- |
| Disallow | /*amateur- |
| Disallow | /*asian- |
| Disallow | /*wp-content |
| Disallow | /*wp-admin |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.localendar.com/sitemap.xml |