isay.ro
robots.txt

Robots Exclusion Standard data for isay.ro

Resource Scan

Scan Details

Site Domain isay.ro
Base Domain isay.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-27T05:47:30+00:00
Next Scan 2025-10-27T05:47:30+00:00

Last Successful Scan

Scanned2025-08-06T05:04:02+00:00
URL https://www.isay.ro/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.32.1
Found Yes
Hash d624d17f5d7830eba7df8489e116714d76a9eb8ba1be06f9545a0dabc899d660
SimHash 4d2c8b5780b1

Groups

*

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

google-display-ads-bot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /
Allow /ads.txt

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

storebot-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

googleother-image

Rule Path
Allow /

googleother-video

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/admin-ajax.php?*
Disallow /cgi-bin/
Disallow /cdn-cgi/
Allow /feed/
Allow */feed/$
Allow */rss/$
Disallow /xmlrpc.php
Disallow /?*
Allow /wp-content/uploads/
Disallow /wp-content/litespeed/
Disallow /*?wordfence_lh=1*

Other Records

Field Value
sitemap https://www.isay.ro/sitemap.xml
sitemap https://www.isay.ro/sitemap-news.xml

Comments

  • LLMs usage policy

Warnings

  • `llm-policy` is not a known field.
  • `llms` is not a known field.
  • `llms-full` is not a known field.