iletaitunepub.fr
robots.txt

Robots Exclusion Standard data for iletaitunepub.fr

Resource Scan

Scan Details

Site Domain iletaitunepub.fr
Base Domain iletaitunepub.fr
Scan Status Ok
Last Scan2024-09-14T09:11:54+00:00
Next Scan 2024-09-21T09:11:54+00:00

Last Scan

Scanned2024-09-14T09:11:54+00:00
URL https://iletaitunepub.fr/robots.txt
Domain IPs 104.21.83.97, 172.67.221.80, 2606:4700:3034::6815:5361, 2606:4700:3035::ac43:dd50
Response IP 172.67.221.80
Found Yes
Hash 683d5f532d29b41e310ea4fe97fa398563af6d6b6026774dcbc625aa5cfce305
SimHash 7377dc224eb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://iletaitunepub.fr/sitemap.xml
sitemap https://iletaitunepub.fr/news-sitemap.xml

Warnings

  • 2 invalid lines.