femi9.com
robots.txt

Robots Exclusion Standard data for femi9.com

Resource Scan

Scan Details

Site Domain femi9.com
Base Domain femi9.com
Scan Status Ok
Last Scan2024-06-06T04:01:46+00:00
Next Scan 2024-06-20T04:01:46+00:00

Last Scan

Scanned2024-06-06T04:01:46+00:00
URL https://femi9.com/robots.txt
Domain IPs 104.26.2.249, 104.26.3.249, 172.67.73.51, 2606:4700:20::681a:2f9, 2606:4700:20::681a:3f9, 2606:4700:20::ac43:4933
Response IP 104.26.2.249
Found Yes
Hash 5bae976fc57f9201846302b418334d242c036972d11cb4784812352c9b7b7740
SimHash 6f105465e19a

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.femi9.com/pub/media/en_sitemap.xml
sitemap https://www.femi9.com/pub/media/ar_sitemap.xml
sitemap https://www.femi9.com/pub/media/sitemap.xml
sitemap https://www.femi9.com/pub/media/vfsitemapea.xml