frichmarket.org
robots.txt

Robots Exclusion Standard data for frichmarket.org

Resource Scan

Scan Details

Site Domain frichmarket.org
Base Domain frichmarket.org
Scan Status Ok
Last Scan2024-11-15T03:19:17+00:00
Next Scan 2024-11-22T03:19:17+00:00

Last Scan

Scanned2024-11-15T03:19:17+00:00
URL https://frichmarket.org/robots.txt
Domain IPs 104.21.1.43, 172.67.128.131, 2606:4700:3030::ac43:8083, 2606:4700:3032::6815:12b
Response IP 104.21.1.43
Found Yes
Hash 7c03a7708fb933fd79a253f271257bdd103e92627035df1b3132d252e6be7e87
SimHash 3958d1005f12

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

archive-fr.com

Rule Path
Disallow /

webmeupbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

voilabot beta 1.2

Rule Path
Disallow /

linkedinbot/1.0

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.frichmarket.org/sitemap.xml
sitemap https://www.frichmarket.org/sitemap-news.xml
sitemap https://www.frichmarket.org/tag-sitemap.php