softfree.eu
robots.txt

Robots Exclusion Standard data for softfree.eu

Resource Scan

Scan Details

Site Domain softfree.eu
Base Domain softfree.eu
Scan Status Ok
Last Scan2024-06-28T17:33:49+00:00
Next Scan 2024-07-05T17:33:49+00:00

Last Scan

Scanned2024-06-28T17:33:49+00:00
URL https://softfree.eu/robots.txt
Domain IPs 82.165.77.190
Response IP 82.165.77.190
Found Yes
Hash 223277a2d0d16a1d71e6b79ff184e4a62b6b64010bac3fb125ff2397f4ed55e8
SimHash 608e58c8dc98

Groups

*

Rule Path
Disallow /reclame/
Disallow /ze/

tweetmemebot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

ning

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

demandbase-bot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

demandbasepublisheranalyzer

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

yak

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

buck

Rule Path
Disallow /

Other Records

Field Value
sitemap https://softfree.eu/sitemap.txt