vintagebmw.org
robots.txt

Robots Exclusion Standard data for vintagebmw.org

Resource Scan

Scan Details

Site Domain vintagebmw.org
Base Domain vintagebmw.org
Scan Status Ok
Last Scan2024-09-24T22:18:56+00:00
Next Scan 2024-10-24T22:18:56+00:00

Last Scan

Scanned2024-09-24T22:18:56+00:00
URL https://vintagebmw.org/robots.txt
Domain IPs 2600:3c00::f03c:92ff:fe92:e075, 45.33.7.158
Response IP 45.33.7.158
Found Yes
Hash 437f680741b0d57e7cb229ebb9c09581d1816f492b331f7b1988e2c08c350bc1
SimHash 693c5f46de92

Groups

*

Rule Path
Disallow /feed/
Disallow /feed
Disallow feed

*

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /maglink?
Disallow /vmcalink?

adidxbot

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Allow /

ahrefsbot/7.0

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vintagebmw.org/sitemap.xml.gz