app-ads.txt.sium.co
robots.txt

Robots Exclusion Standard data for app-ads.txt.sium.co

Resource Scan

Scan Details

Site Domain app-ads.txt.sium.co
Base Domain sium.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-06-29T08:43:31+00:00
Next Scan 2024-09-27T08:43:31+00:00

Last Successful Scan

Scanned2023-11-10T08:41:06+00:00
URL http://app-ads.txt.sium.co/robots.txt
Domain IPs 142.132.137.12
Response IP 142.132.137.12
Found Yes
Hash 3864cb5cebd95e816712c61a36587ff27a0ff8289111a7e7f445e6baa8cc485d
SimHash 703c8122c553

Groups

*

Rule Path
Disallow /config/*
Disallow /includes/*
Disallow /page/
Allow /recent/

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

linko

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

httrack

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap http://sium.co/cleaned_sitemap/sitemap.xml