webmarco.com
robots.txt

Robots Exclusion Standard data for webmarco.com

Resource Scan

Scan Details

Site Domain webmarco.com
Base Domain webmarco.com
Scan Status Ok
Last Scan2025-06-05T17:58:40+00:00
Next Scan 2025-07-05T17:58:40+00:00

Last Scan

Scanned2025-06-05T17:58:40+00:00
URL https://webmarco.com/robots.txt
Domain IPs 104.21.56.33, 172.67.176.103, 2606:4700:3030::6815:3821, 2606:4700:3037::ac43:b067
Response IP 172.67.176.103
Found Yes
Hash 66cc106975c6996f96055b5c77ee3f13bb0c61f14c8e14e7dba37f685f48da14
SimHash c1045321c7f7

Groups

applebot

Rule Path
Disallow /app/
Allow /

bingbot

Rule Path
Disallow /app/
Allow /

duckduckbot

Rule Path
Disallow /app/
Allow /

googlebot

Rule Path
Disallow /app/
Allow /

googlebot-image

Rule Path
Disallow /app/
Allow /

googlebot-news

Rule Path
Disallow /app/
Allow /

google-inspectiontool

Rule Path
Disallow /app/
Allow /

googleother

Rule Path
Disallow /app/
Allow /

adsbot-google

Rule Path
Disallow /app/
Allow /

linkedinbot

Rule Path
Disallow /app/
Allow /

pinterestbot

Rule Path
Disallow /app/
Allow /

twitterbot

Rule Path
Disallow /app/
Allow /

*

Rule Path
Disallow /