pitimana.fr
robots.txt

Robots Exclusion Standard data for pitimana.fr

Resource Scan

Scan Details

Site Domain pitimana.fr
Base Domain pitimana.fr
Scan Status Ok
Last Scan2024-06-24T00:59:25+00:00
Next Scan 2024-07-01T00:59:25+00:00

Last Scan

Scanned2024-06-24T00:59:25+00:00
URL https://pitimana.fr/robots.txt
Domain IPs 5.135.242.203
Response IP 5.135.242.203
Found Yes
Hash 645199193eea915eeafa7fd8f2a353ba032c96be5f80d5092c6b2fcb0e177723
SimHash 7bbe482060b9

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

gptbot
google-extended
anthropic-ai
bytespider
ccbot
chatgpt-user
cohere-ai
facebookbot
omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://pitimana.fr/sitemap-news.xml
sitemap https://pitimana.fr/sitemap_index.xml

Comments

  • XML Sitemap & Google News version 5.4.9 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.