Log In Sign Up

thenextscoop.com
robots.txt

Robots Exclusion Standard data for thenextscoop.com

Resource Scan

Scan Details

Site Domain thenextscoop.com
Base Domain thenextscoop.com
Scan Status Ok
Last Scan2024-11-09T13:36:42+00:00
Next Scan 2024-11-16T13:36:42+00:00

Last Scan

Scanned2024-11-09T13:36:42+00:00
URL https://thenextscoop.com/robots.txt
Domain IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash cf1cdc5a05a3fbd544bf4bbc323d8cd6a5113c3c7408f8cbcda8108159f6666a
SimHash 67094a40c643

Groups

*

Rule Path
Disallow /?s=*
Disallow /page/
Disallow /tns/
Disallow /cgi-bin/
Disallow /comments/feed/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /tag/*/feed/
Disallow /*/feed/
Disallow /*/feed

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Disallow /comments/feed/
Disallow /tag/*/feed/
Disallow /*/feed/
Disallow /*/feed

bingbot

Rule Path
Disallow /comments/feed/
Disallow /tag/*/feed/
Disallow /*/feed/
Disallow /*/feed

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/
Back to top

Other Records

Field Value
sitemap https://thenextscoop.com/sitemap_index.xml
Back to top

Comments

  • WP Import Export Rule
Back to top

Warnings

  • `noindex` is not a known field.
Back to top