wjol.com
robots.txt

Robots Exclusion Standard data for wjol.com

Resource Scan

Scan Details

Site Domain wjol.com
Base Domain wjol.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-17T03:00:37+00:00
Next Scan 2026-01-24T03:00:37+00:00

Last Successful Scan

Scanned2024-09-14T21:12:03+00:00
URL https://wjol.com/robots.txt
Redirect https://www.wjol.com/?robots=1
Redirect Domain www.wjol.com
Redirect Base wjol.com
Domain IPs 104.21.11.165, 172.67.149.150, 2606:4700:3035::ac43:9596, 2606:4700:3036::6815:ba5
Redirect IPs 104.21.11.165, 172.67.149.150, 2606:4700:3035::ac43:9596, 2606:4700:3036::6815:ba5
Response IP 104.21.11.165
Found Yes
Hash 267455c379eab346822c2660528ca6b96f43417e525f99a7e32272141b3266d8
SimHash 79435907e636

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-login.php
Disallow /wp-includes/*
Disallow /wp-content/*
Disallow /trackback
Disallow /feed
Disallow */comments
Disallow */comments-page-*
Disallow */trackback
Disallow */feed
Disallow */comments
Allow /wp-content/cache/*
Allow /wp-content/uploads/*
Allow /wp-content/themes/*
Allow /wp-content/plugins/*
Allow /wp-includes/js/*
Allow /wp-includes/css/*
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *pagename%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow *outlook-ical%3D*
Disallow *related_series%3D*
Disallow *tribe_geofence%3D*
Disallow *tribe_organizer%3D*
Allow /events/*
Allow /event/*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.wjol.com/sitemap.xml

Warnings

  • 1 invalid line.