- This topic has 5 replies, 2 voices, and was last updated 10 years, 10 months ago by
.
-
Posts
-
We are getting crawl errors from empty dates, some 404 but thousands of “duplicate content” errors. Investigating whether the <meta name=”robots” content=”noindex,follow” /> tag was in the header, I found that, if I get to a page with no events by
1. searching for a word in the tribe bar in week or month view, or
2. using the previous / next day links in day view
the meta robots tag is in the header.However, if I get to a day with no events by selecting a date from the datepicker in the tribe bar, the meta robots tag is not in the page header, and the URL does not change to the chosen date.
Checking further, selecting a day from the datepicker does not update the URL whether or not there is an event for that day. Selecting a week or month from the datepicker does change the URL.
When I went back and looked at the flagged event urls in both the duplicated content and 4XX error reports, they all end in a date – most are /events/date or events/category/name-of-category/date.
Examples:
search in week: http://www.sierranevada.edu/events/week/2015-05-31/?tribe-bar-date=2015-05-31&tribe-bar-search=commencement
search in month: http://www.sierranevada.edu/events/2015-06/?tribe-bar-date=2015-06&tribe-bar-search=commencement
next day link: http://www.sierranevada.edu/events/2015-06-08/
next week link: http://www.sierranevada.edu/events/week/2015-06-07
datepicker: cannot post URL because it hasn’t updatedThanks, Susan
Hi Susan,
Thanks for reaching us in the forums. Let me see if I got this right:
All the URLs you listed have robots meta set to “no-index, follow”, so you are safe with those. And since the “Datepicker URL” is only reachable via form submission it won’t be crawled at all.
There’s a Knowledgebase post on 404s and SEO that will help you better understand this.
Please let me know if this answers your inquire.
Nico
If results from form submissions are being crawled how are all the category/date urls in the duplicated content results below being found?
Somehow empty dates are being crawled, because we have 53 404 results for empty dates.
The bigger issue is duplicated content results from empty dates. The crawler is finding /events/date, events/category/date, and events/category/subcategory/date, and considering all empties as duplicated content. The result is 7,716 duplicated content results from events. For example, all the urls below are listed as duplcated content for http://www.sierranevada.edu/events/2015-06-28/:
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-26
http://www.sierranevada.edu/events/category/student/2015-08-20
http://www.sierranevada.edu/events/category/student/2015-08-12
http://www.sierranevada.edu/events/category/student/2015-07-19
http://www.sierranevada.edu/events/category/student/2015-07-20
http://www.sierranevada.edu/events/category/student/2015-07-21
http://www.sierranevada.edu/events/category/student/2015-08-17|http://www.sierranevada.edu/events/2015-07-11
http://www.sierranevada.edu/events/2015-08-30
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-20
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-02
http://www.sierranevada.edu/events/category/student/2015-07-26
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-11
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-04
http://www.sierranevada.edu/events/category/student/2015-07-28
http://www.sierranevada.edu/events/category/student/2015-08-19
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-28
http://www.sierranevada.edu/events/category/student/2015-08-07
http://www.sierranevada.edu/events/category/student/2015-08-25
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-15
http://www.sierranevada.edu/events/category/student/undergrad-student/2015-08-30
http://www.sierranevada.edu/events/category/student/2015-08-09
http://www.sierranevada.edu/events/category/student/2015-08-27
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-09
http://www.sierranevada.edu/events/category/student/2015-08-24
http://www.sierranevada.edu/events/category/student/2015-07-02
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-21
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-31
http://www.sierranevada.edu/events/category/student/student-activities/2015-08-27
http://www.sierranevada.edu/events/category/student/2015-07-04
http://www.sierranevada.edu/events/category/student/2015-07-05
http://www.sierranevada.edu/events/category/student/student-activities/2015-08-04
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-19
http://www.sierranevada.edu/events/category/student/2015-07-31
http://www.sierranevada.edu/events/category/student/2015-07-07
http://www.sierranevada.edu/events/category/student/2015-08-02
http://www.sierranevada.edu/events/category/student/2015-08-04
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-05
http://www.sierranevada.edu/events/category/student/student-activities/2015-08-02
http://www.sierranevada.edu/events/category/student/2015-07-09
http://www.sierranevada.edu/events/category/student/2015-07-12
http://www.sierranevada.edu/events/category/student/2015-07-13
http://www.sierranevada.edu/events/category/student/student-activities/2015-08-01
http://www.sierranevada.edu/events/category/student/2015-08-01
http://www.sierranevada.edu/events/category/student/2015-08-18
http://www.sierranevada.edu/events/category/student/2015-08-06
http://www.sierranevada.edu/events/2015-06-23
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-07
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-12
http://www.sierranevada.edu/events/category/student/student-activities/2015-07-13Sorry, the first line above should read “If results from form submissions are not being crawled how are all the category/date urls in the duplicated content results below being found?”
Hi Susan,
Thanks for the follow up!
I’m googling some of the URLs you provided in the list, with ‘site:’ and ‘info:’ commands to check if they are indexed but I don’t get any results. On the other hand if I google (with the same commands) other URLs (non calendar related) of your site like:
http://www.sierranevada.edu/academics/teacher-education/teacher-recertification/
http://www.sierranevada.edu/athletics/cross-country/
http://www.sierranevada.edu/community/giving/
They do have results available. So I understand the empty calendar pages are not indexed.Anyways I’m not a SEO expert and can be wrong about it. What tool are you using to check on this? Maybe the tool shows you a warning for duplicated content -which of course exists- but doesn’t check if the content is actually indexed?
Please let me know about those questions so we can investigate further,
Thanks,
Nico
- The topic ‘Empty dates generating crawl errors’ is closed to new replies.