listelist.com
robots.txt

Robots Exclusion Standard data for listelist.com

Resource Scan

Scan Details

Site Domain listelist.com
Base Domain listelist.com
Scan Status Ok
Last Scan2024-11-13T11:45:16+00:00
Next Scan 2024-11-20T11:45:16+00:00

Last Scan

Scanned2024-11-13T11:45:16+00:00
URL https://listelist.com/robots.txt
Domain IPs 104.247.188.65
Response IP 104.247.188.65
Found Yes
Hash 288b7019b494566e85a9c3c1ecff27ecde760411e24afbe5ffba3e3de81a792d
SimHash 0b1c5c48c8e2

Groups

*

Rule Path
Disallow */?s=*
Allow /?s=*
Disallow /?p=*
Disallow /*_ppp%3D*
Disallow */embed/
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /search/
Disallow /wp-json/
Disallow /324749355%2C72694299/
Disallow /shop/
Disallow /83039022/
Disallow /72694299/
Disallow /rw_test/
Disallow /sellers.json
Disallow /.well-known/
Disallow /cdn-cgi/

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

freefind

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://listelist.com/sitemap_index.xml