pigiame.co.ke
robots.txt

Robots Exclusion Standard data for pigiame.co.ke

Resource Scan

Scan Details

Site Domain pigiame.co.ke
Base Domain pigiame.co.ke
Scan Status Ok
Last Scan2024-09-27T04:46:43+00:00
Next Scan 2024-10-04T04:46:43+00:00

Last Scan

Scanned2024-09-27T04:46:43+00:00
URL https://pigiame.co.ke/robots.txt
Redirect https://www.pigiame.co.ke/robots.txt
Redirect Domain www.pigiame.co.ke
Redirect Base pigiame.co.ke
Domain IPs 104.16.112.234, 104.16.207.161, 2606:4700::6810:70ea, 2606:4700::6810:cfa1
Redirect IPs 104.16.112.234, 104.16.207.161, 2606:4700::6810:70ea, 2606:4700::6810:cfa1
Response IP 104.16.207.161
Found Yes
Hash f6600119abd2c2192369a292e1e86d50eb23709b3762c02c8cac6ea33d84af0d
SimHash 4c0105416ef3

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /admin/*
Disallow /account/*
Allow /account/login

twitterbot

Rule Path
Allow *

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.pigiame.co.ke/sitemap-category-en.xml
sitemap https://www.pigiame.co.ke/sitemap-directory-category-en.xml
sitemap https://www.pigiame.co.ke/sitemap-directory-en.xml
sitemap https://www.pigiame.co.ke/sitemap-listings-index-en.xml
sitemap https://www.pigiame.co.ke/sitemap-static-en.xml
sitemap https://www.pigiame.co.ke/sitemap-popular-searches-en.xml