Log In Sign Up

hinduifestival.com
robots.txt

Robots Exclusion Standard data for hinduifestival.com

Resource Scan

Scan Details

Site Domain hinduifestival.com
Base Domain hinduifestival.com
Scan Status Ok
Last Scan2024-09-22T04:17:40+00:00
Next Scan 2024-09-29T04:17:40+00:00

Last Scan

Scanned2024-09-22T04:17:40+00:00
URL https://hinduifestival.com/robots.txt
Domain IPs 104.21.87.81, 172.67.142.130, 2606:4700:3034::6815:5751, 2606:4700:3034::ac43:8e82
Response IP 104.21.87.81
Found Yes
Hash bbd17f8cf112c440f90f481870bf9c73786fb46bd7c7c69c5d1cfd310e9a29b8
SimHash 800592706da2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://hinduifestival.com/sitemap_index.xml
Back to top