trendfeed.info
robots.txt

Robots Exclusion Standard data for trendfeed.info

Resource Scan

Scan Details

Site Domain trendfeed.info
Base Domain trendfeed.info
Scan Status Ok
Last Scan2024-06-28T22:01:43+00:00
Next Scan 2024-07-05T22:01:43+00:00

Last Scan

Scanned2024-06-28T22:01:43+00:00
URL https://trendfeed.info/robots.txt
Domain IPs 154.41.252.21, 2a02:4780:38:1e60:49c:7858:f59:e043
Response IP 154.41.252.21
Found Yes
Hash 1fe5768115b81e9f2cf444f7d7a44d1f49c011ce289dd12a1404696261a488e1
SimHash 6e311b80f292

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /dgd_scrollbox/
Disallow /wp-admin/
Disallow /linkout/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /go/
Disallow /recommended/
Disallow /Recommended/

ninjabot

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://trendfeed.info/sitemap.xml
sitemap https://trendfeed.info/sitemap.rss