kemifilani.com
robots.txt

Robots Exclusion Standard data for kemifilani.com

Resource Scan

Scan Details

Site Domain kemifilani.com
Base Domain kemifilani.com
Scan Status Ok
Last Scan2024-09-19T08:06:42+00:00
Next Scan 2024-09-26T08:06:42+00:00

Last Scan

Scanned2024-09-19T08:06:42+00:00
URL https://kemifilani.com/robots.txt
Redirect https://www.kemifilani.ng/robots.txt
Redirect Domain www.kemifilani.ng
Redirect Base kemifilani.ng
Domain IPs 104.26.12.17, 104.26.13.17, 172.67.74.41, 2606:4700:20::681a:c11, 2606:4700:20::681a:d11, 2606:4700:20::ac43:4a29
Redirect IPs 104.26.12.113, 104.26.13.113, 172.67.75.129, 2606:4700:20::681a:c71, 2606:4700:20::681a:d71, 2606:4700:20::ac43:4b81
Response IP 104.26.13.113
Found Yes
Hash bedd39092144e161a716728de482817bbd516284d4d5becd448f7437aeddd622
SimHash f80288888312

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /page/*?s=

node/simplecrawler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kemifilani.ng/sitemap_index.xml