Log In Sign Up

amiracledetailing.com
robots.txt

Robots Exclusion Standard data for amiracledetailing.com

Resource Scan

Scan Details

Site Domain amiracledetailing.com
Base Domain amiracledetailing.com
Scan Status Ok
Last Scan2025-11-28T13:23:34+00:00
Next Scan 2025-12-28T13:23:34+00:00

Last Scan

Scanned2025-11-28T13:23:34+00:00
URL https://amiracledetailing.com/robots.txt
Domain IPs 106.0.62.78
Response IP 106.0.62.78
Found Yes
Hash 4b5c34aaf06e46ac5e307586d2f5103e66cdf365ce7a997b043f58a2c9a0c14a
SimHash 51139100e5d2

Groups

roverbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

googlebot
bingbot
duckduckbot
duckduckgo
*

Rule Path
Disallow
Disallow /error/
Disallow /~4521940.5360431/
Disallow /carwax/
Disallow /hdtruck/
Back to top

Other Records

Field Value
sitemap https://amiracledetailing.com/sitemap.xml
Back to top

Comments

  • Robots.txt AMiracleDetailing.com 06-24-2024 9:30am
  • Rover is a Bad Dog
  • Block the Common Crawl bot
  • Block Petal Search - Singapore
  • Added 06-06-2024 to block AI Crawler Bots
  • ----------------------------------
  • This example should only allow googlebot - bingbot and DuckDuckGo and reject all others including ai crawlers.
  • User-agent: *
  • Disallow: /
  • ----------------------------------
Back to top