nextnews.fr
robots.txt

Robots Exclusion Standard data for nextnews.fr

Resource Scan

Scan Details

Site Domain nextnews.fr
Base Domain nextnews.fr
Scan Status Ok
Last Scan2024-09-27T06:47:17+00:00
Next Scan 2024-10-04T06:47:17+00:00

Last Scan

Scanned2024-09-27T06:47:17+00:00
URL https://nextnews.fr/robots.txt
Domain IPs 109.234.160.38
Response IP 109.234.160.38
Found Yes
Hash 20adbe4c534449b7bbd99919ad90aff91fc676e940cea6a601aaf7be6d14b0c0
SimHash 63055048e1b3

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=*
Allow /*css?*
Allow /*js?*
Disallow /cdn-cgi/

ia_archiver
textbulkerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nextnews.fr/sitemap.xml
sitemap https://www.nextnews.fr/sitemap-news.xml

Warnings

  • `useragent` is not a known field.