motorcycleclassics.com
robots.txt

Robots Exclusion Standard data for motorcycleclassics.com

Resource Scan

Scan Details

Site Domain motorcycleclassics.com
Base Domain motorcycleclassics.com
Scan Status Ok
Last Scan2024-09-19T00:16:00+00:00
Next Scan 2024-09-26T00:16:00+00:00

Last Scan

Scanned2024-09-19T00:16:00+00:00
URL https://motorcycleclassics.com/robots.txt
Redirect https://www.motorcycleclassics.com/robots.txt
Redirect Domain www.motorcycleclassics.com
Redirect Base motorcycleclassics.com
Domain IPs 34.235.220.207, 54.80.48.192
Redirect IPs 34.235.220.207, 54.80.48.192
Response IP 34.235.220.207
Found Yes
Hash c3410899e1b3d9ce7ad03aab2333aeaffc001f2f1a89fc86aaa79cf56c3f9cc6
SimHash 03a59a60dba3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /_custom/*
Disallow /*/print/
Disallow /wp-json/*
Disallow /search/*
Disallow /email
Disallow /print
Disallow /print-article.aspx
Disallow /sso/*
Disallow /store/offer/*
Disallow /store/author/*
Disallow /watch/*
Disallow /uploadedFiles/*
Disallow /tags/*
Disallow /search
Disallow /contributors/*

rogerbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /_custom/
Disallow /wp-json/

twitterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /wp-json/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.motorcycleclassics.com/sitemap.xml