reliable.ad9g.com
robots.txt

Robots Exclusion Standard data for reliable.ad9g.com

Resource Scan

Scan Details

Site Domain reliable.ad9g.com
Base Domain ad9g.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T08:28:29+00:00
Next Scan 2024-11-06T08:28:29+00:00

Last Successful Scan

Scanned2024-07-10T08:27:15+00:00
URL https://reliable.ad9g.com/robots.txt
Domain IPs 104.21.72.232, 172.67.155.171, 2606:4700:3031::6815:48e8, 2606:4700:3031::ac43:9bab
Response IP 172.67.155.171
Found Yes
Hash 026e886b523d172e3528de914578c7471a691ba5575a5ff24e5ea06b10923187
SimHash 523c9366cc03

Groups

*

Rule Path
Allow /
Disallow *r.php*
Disallow */page/search/*
Disallow */page/?p*
Disallow */form/*
Disallow */page/?p*
Disallow */offers/*

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

proximic

Rule Path
Disallow /

yandex

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://reliable.ad9g.com/s/k/category.txt
sitemap https://reliable.ad9g.com/sitemap_index.xml
sitemap https://reliable.ad9g.com/s/k/pages.xml
sitemap https://reliable.ad9g.com/s/k/pages_0.txt
sitemap https://reliable.ad9g.com/s/k/cat_categories.txt
sitemap https://reliable.ad9g.com/s/m/cake/0.txt
sitemap https://reliable.ad9g.com/s/k/cat_brand.txt
sitemap https://reliable.ad9g.com/s/k/cat_tag.txt