mobileread.com
robots.txt

Robots Exclusion Standard data for mobileread.com

Resource Scan

Scan Details

Site Domain mobileread.com
Base Domain mobileread.com
Scan Status Ok
Last Scan2024-09-21T21:09:32+00:00
Next Scan 2024-09-28T21:09:32+00:00

Last Scan

Scanned2024-09-21T21:09:32+00:00
URL https://mobileread.com/robots.txt
Redirect https://www.mobileread.com/robots.txt
Redirect Domain www.mobileread.com
Redirect Base mobileread.com
Domain IPs 162.55.243.172
Redirect IPs 162.55.243.172
Response IP 162.55.243.172
Found Yes
Hash ac20c90994be808e60c56d41e142d14dbfb46159233709f4018880946017203f
SimHash abd89890ef80

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /forums/admincp/
Disallow /forums/modcp/
Disallow /forums/ajax.php
Disallow /forums/asearch.php
Disallow /forums/calendar.php
Disallow /forums/chat.php
Disallow /forums/cron.php
Disallow /forums/editpost.php
Disallow /forums/faq.php
Disallow /forums/global.php
Disallow /forums/image.php
Disallow /forums/infraction.php
Disallow /forums/inlinemod.php
Disallow /forums/joinrequests.php
Disallow /forums/login.php
Disallow /forums/member.php
Disallow /forums/memberlist.php
Disallow /forums/misc.php
Disallow /forums/moderator.php
Disallow /forums/newattachment.php
Disallow /forums/newreply.php
Disallow /forums/newthread.php
Disallow /forums/online.php
Disallow /forums/poll.php
Disallow /forums/postings.php
Disallow /forums/printthread.php
Disallow /forums/private.php
Disallow /forums/profile.php
Disallow /forums/register.php
Disallow /forums/report.php
Disallow /forums/reputation.php
Disallow /forums/search.php
Disallow /forums/sendmessage.php
Disallow /forums/showgroups.php
Disallow /forums/subscription.php
Disallow /forums/threadrate.php
Disallow /forums/usercp.php
Disallow /forums/usernote.php
Disallow /forums/invite.php
Disallow /forums/spy.php
Disallow /forums/asearch.php
Disallow /forums/contest.php
Disallow /forums/downthread.php
Disallow /forums/memberfeed.php
Disallow /forums/usermap.php

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

e-societyrobot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

synthesio crawler release monalisa (contact at synthesio dot fr)

Rule Path
Disallow /