exprto.com
robots.txt

Robots Exclusion Standard data for exprto.com

Resource Scan

Scan Details

Site Domain exprto.com
Base Domain exprto.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-11T20:13:40+00:00
Next Scan 2025-11-09T20:13:40+00:00

Last Successful Scan

Scanned2024-03-27T18:51:59+00:00
URL https://exprto.com/robots.txt
Domain IPs 3.110.179.135
Response IP 3.110.179.135
Found Yes
Hash 549cfdb1bdb8d52eb74bb4c54e5d10afc59faf436d98273bf32a34fca6c15294
SimHash 2c5575824593

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

googlebot

Rule Path
Disallow
Disallow /cgi-bin/

googlebot-image

Rule Path
Disallow
Disallow /cgi-bin/

googlebot-mobile

Rule Path
Disallow
Disallow /cgi-bin/

msnbot

Rule Path
Disallow
Disallow /cgi-bin/

slurp

Rule Path
Disallow
Disallow /cgi-bin/

teoma

Rule Path
Disallow
Disallow /cgi-bin/

gigabot

Rule Path
Disallow
Disallow /cgi-bin/

robozilla

Rule Path
Disallow
Disallow /cgi-bin/

nutch

Rule Path
Disallow
Disallow /cgi-bin/

ia_archiver

Rule Path
Disallow
Disallow /cgi-bin/

baiduspider

Rule Path
Disallow
Disallow /cgi-bin/

naverbot

Rule Path
Disallow
Disallow /cgi-bin/

yeti

Rule Path
Disallow
Disallow /cgi-bin/

yahoo-mmcrawler

Rule Path
Disallow
Disallow /cgi-bin/

psbot

Rule Path
Disallow
Disallow /cgi-bin/

yahoo-blogs/v3.9

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.exprto.com/sitemap.xml