racetrackworld.com
robots.txt

Robots Exclusion Standard data for racetrackworld.com

Resource Scan

Scan Details

Site Domain racetrackworld.com
Base Domain racetrackworld.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/17/2025, 8:56:04 PM
Next Scan 7/17/2025, 8:56:04 PM

Last Successful Scan

Scanned5/19/2025, 7:58:03 PM
URL https://racetrackworld.com/robots.txt
Domain IPs 108.171.214.90
Response IP 108.171.214.90
Found Yes
Hash 97bbe73466ad2be45c7c3733b20b6e5105fe16a6dded32ded45626ac02521d45
SimHash 5a18d020ee80

Groups

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /*/?
Disallow /?
Disallow /*/feed
Disallow /reviews
Disallow /comments
Disallow /blogs/?*
Disallow /page/*/?*
Disallow /author
Disallow /*/1000
Disallow /*//1000
Disallow /detroitchicago/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

abonti

Rule Path
Disallow /

a6-indexer

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

yahoo pipes 2.0

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://racetrackworld.com/sitemap_index.xml
sitemap https://racetrackworld.com/post-sitemap1.xml
sitemap https://racetrackworld.com/post-sitemap2.xml
sitemap https://racetrackworld.com/post-sitemap3.xml
sitemap https://racetrackworld.com/post-sitemap4.xml
sitemap https://racetrackworld.com/page-sitemap1.xml
sitemap https://racetrackworld.com/page-sitemap2.xml
sitemap https://racetrackworld.com/page-sitemap3.xml
sitemap https://racetrackworld.com/category-sitemap.xml
sitemap https://racetrackworld.com/news-sitemap.xml

Warnings

  • 4 invalid lines.