mrkennedy.pbworks.com
robots.txt

Robots Exclusion Standard data for mrkennedy.pbworks.com

Resource Scan

Scan Details

Site Domain mrkennedy.pbworks.com
Base Domain pbworks.com
Scan Status Ok
Last Scan2025-08-22T13:13:55+00:00
Next Scan 2025-09-21T13:13:55+00:00

Last Scan

Scanned2025-08-22T13:13:55+00:00
URL https://mrkennedy.pbworks.com/robots.txt
Domain IPs 208.96.18.237, 208.96.18.238
Response IP 208.96.18.237
Found Yes
Hash db21106359f030ae4e734ce4599cca2d4428428646ce3945e06bab82401451a4
SimHash 634bda9aebb2

Groups

googlebot

Rule Path
Disallow /*?
Disallow /*%5C.
Allow /f/*

*

Rule Path
Disallow /session/
Disallow /settings/
Disallow /browse/
Disallow /w/browse/
Disallow /layout/
Disallow /rss.xml
Disallow /report.php
Disallow /w/newpage
Disallow /tags.php
Disallow /request_access.php
Disallow /theme_css.php
Disallow /view_img.php
Disallow /upgrade.php
Disallow /2-easy-ways
Disallow /RecentActivity
Disallow /WhatWikiIs
Disallow /changelist.php
Disallow /changes/
Disallow /changes.php
Disallow /AllPages
Disallow /FindPage
Disallow /admin.php
Disallow /help.php
Disallow /report.php
Disallow /contact.php

Other Records

Field Value
crawl-delay 600

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://mrkennedy.pbworks.com/sitemap.xml

Comments

  • Public, indexed site.