abraa.com
robots.txt

Robots Exclusion Standard data for abraa.com

Resource Scan

Scan Details

Site Domain abraa.com
Base Domain abraa.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-10T05:59:49+00:00
Next Scan 2025-11-08T05:59:49+00:00

Last Successful Scan

Scanned2022-12-29T15:01:47+00:00
URL https://abraa.com/robots.txt
Redirect https://www.abraa.com/robots.txt
Redirect Domain www.abraa.com
Redirect Base abraa.com
Domain IPs 104.21.23.180, 172.67.212.119, 2606:4700:3030::ac43:d477, 2606:4700:3037::6815:17b4
Redirect IPs 104.21.23.180, 172.67.212.119, 2606:4700:3030::ac43:d477, 2606:4700:3037::6815:17b4
Response IP 172.67.212.119
Found Yes
Hash 4f1a0396057fba117cd20acd2b6dc4583345042c8148b5dce5451e8f1087d86d
SimHash 4904f8145131

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /_notes/
Disallow /login?to=
Disallow /settings/
Disallow /cache/
Disallow /templates/
Disallow /buy-request/
Disallow /store/

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

twitterbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.abraa.com/categories-sitemap.xml
sitemap https://www.abraa.com/items-sitemap.xml
sitemap https://www.abraa.com/stores-sitemap.xml
sitemap https://www.abraa.com/pages-sitemap.xml
sitemap https://www.abraa.com/bulkitems-sitemap.xml

Comments

  • Mediapartners Google
  • Google-Image