auto55.mobi
robots.txt

Robots Exclusion Standard data for auto55.mobi

Resource Scan

Scan Details

Site Domain auto55.mobi
Base Domain auto55.mobi
Scan Status Ok
Last Scan2024-09-24T09:52:52+00:00
Next Scan 2024-10-01T09:52:52+00:00

Last Scan

Scanned2024-09-24T09:52:52+00:00
URL https://auto55.mobi/robots.txt
Domain IPs 2a01:4f8:c0c:2bfb::1, 94.130.180.231
Response IP 94.130.180.231
Found Yes
Hash f7e8e9c504799a698a0164105398bde94d423ce3f96df920c9d60c438a3d7cdb
SimHash 6008dba35635

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler
spatie/laravel-uptime-monitor uptime checker

Rule Path
Allow /
Disallow /assets

Comments

  • but allow only important bots