Log In Sign Up

aftermarketnews.com
robots.txt

Robots Exclusion Standard data for aftermarketnews.com

Resource Scan

Scan Details

Site Domain aftermarketnews.com
Base Domain aftermarketnews.com
Scan Status Ok
Last Scan2024-06-16T09:47:17+00:00
Next Scan 2024-06-23T09:47:17+00:00

Last Scan

Scanned2024-06-16T09:47:17+00:00
URL https://aftermarketnews.com/robots.txt
Domain IPs 104.26.14.44, 104.26.15.44, 172.67.74.210, 2606:4700:20::681a:e2c, 2606:4700:20::681a:f2c, 2606:4700:20::ac43:4ad2
Response IP 104.26.14.44
Found Yes
Hash 1fb89ae2e67196a6ca6cdcf15375f1bb6600b959cd35d269eb5fe1e3f12954a2
SimHash e015da3ae647

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top