wlip.com
robots.txt

Robots Exclusion Standard data for wlip.com

Resource Scan

Scan Details

Site Domain wlip.com
Base Domain wlip.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T15:45:06+00:00
Next Scan 2024-09-22T15:45:06+00:00

Last Successful Scan

Scanned2024-09-14T15:37:48+00:00
URL https://wlip.com/robots.txt
Redirect https://www.wlip.com/?robots=1
Redirect Domain www.wlip.com
Redirect Base wlip.com
Domain IPs 104.21.4.237, 172.67.154.64, 2606:4700:3030::ac43:9a40, 2606:4700:3031::6815:4ed
Redirect IPs 104.21.4.237, 172.67.154.64, 2606:4700:3030::ac43:9a40, 2606:4700:3031::6815:4ed
Response IP 104.21.4.237
Found Yes
Hash 9023672f17e327e49080b4830d24cf9e23686bfb75bf32c865ab49872e5acc60
SimHash 69631907e652

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-login.php
Disallow /wp-includes/*
Disallow /wp-content/*
Disallow /trackback
Disallow /feed
Disallow */comments
Disallow */comments-page-*
Disallow */trackback
Disallow */feed
Disallow */comments
Allow /wp-content/cache/*
Allow /wp-content/uploads/*
Allow /wp-content/themes/*
Allow /wp-content/plugins/*
Allow /wp-includes/js/*
Allow /wp-includes/css/*
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *pagename%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow *outlook-ical%3D*
Disallow *related_series%3D*
Disallow *tribe_geofence%3D*
Disallow *tribe_organizer%3D*
Allow /events/*
Allow /event/*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.wlip.com/sitemap.xml

Warnings

  • 1 invalid line.