ai-summary.com
robots.txt

Robots Exclusion Standard data for ai-summary.com

Resource Scan

Scan Details

Site Domain ai-summary.com
Base Domain ai-summary.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-10-24T20:19:40+00:00
Next Scan 2024-12-23T20:19:40+00:00

Last Successful Scan

Scanned2024-08-26T19:50:19+00:00
URL https://ai-summary.com/robots.txt
Domain IPs 34.149.120.3, 34.160.81.203, 35.190.31.54, 35.227.194.51
Response IP 34.160.81.203
Found Yes
Hash 879160a98e17f3e57cec01157c3d7df5d0585eddf57ea5645da08a8acda74ead
SimHash e05c88327b32

Groups

dotbot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

photon/1.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metadatascraper

Rule Path
Disallow /