homeandtextilestoday.com
robots.txt

Robots Exclusion Standard data for homeandtextilestoday.com

Resource Scan

Scan Details

Site Domain homeandtextilestoday.com
Base Domain homeandtextilestoday.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-10T12:10:11+00:00
Next Scan 2024-12-09T12:10:11+00:00

Last Successful Scan

Scanned2022-11-14T19:29:09+00:00
URL http://homeandtextilestoday.com/robots.txt
Redirect http://www.hometextilestoday.com/robots.txt
Redirect Domain www.hometextilestoday.com
Redirect Base hometextilestoday.com
Response IP 35.227.121.91
Found Yes
Hash cdcd1d1384d08bae7b54ee6600d46186844c613b8e643817c5883fbfec3c712f
SimHash 4834d290c1a7

Groups

applebot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

baiduspider

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

bingbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

msnbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

naverbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

seznambot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

slurp

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

teoma

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

yeti

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mediapartners-google

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /