estnn.com
robots.txt

Robots Exclusion Standard data for estnn.com

Resource Scan

Scan Details

Site Domain estnn.com
Base Domain estnn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-24T16:51:40+00:00
Next Scan 2025-01-22T16:51:40+00:00

Last Successful Scan

Scanned2023-12-30T05:37:48+00:00
URL https://estnn.com/robots.txt
Domain IPs 104.18.8.132, 104.18.9.132, 2606:4700::6812:884, 2606:4700::6812:984
Response IP 104.18.9.132
Found Yes
Hash 1db66ffc5afdab563438d488b1c5ff8f7c57fc5fd31f9d6eec822eb2a8cb6a3f
SimHash cc05c9dae912

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php?action=ai_ajax*
Disallow /search/
Disallow /*?s=
Disallow /penulis/
Disallow /wp-json/wp/v2/
Disallow /gambling/wp-json/wp/v2/
Disallow *?*=
Disallow *?s
Disallow *?%2F
Disallow */?title
Allow *.css
Allow *.js
Disallow /wp-content/plugins/retargetting/call-ajax.php
Disallow /gambling/wp-content/plugins/retargetting/call-ajax.php
Disallow /author/*/page/
Disallow /gambling/go-*
Allow /gambling/nba-picks-today/

Other Records

Field Value
sitemap https://estnn.com/sitemap_index.xml
sitemap https://estnn.com/news-sitemap.xml/
sitemap https://estnn.com/gambling/sitemap_index.xml