Scheduled Import running on private Intranet site not importing new events

[Mark Evilsizor]

On our Intranet site (which is only accessible inside our organization which is controlled by .htaccess IP settings), when scheduled import jobs run, new events on the source site are not being ingested. But when I run it manually, new events are ingested.

Both the source site and the consuming site are in the same WP MU installation. I wonder if our IP blocking setup for this site relate to this problem. I also wonder as to the role of the TEC Aggregator website in the data flow and whether the fact that our site is private prevents the data flow. Can you elaborate on how the data flows when the import job runs? My concept of it is likely incomplete or flawed, but following is my understanding

a.) My import job contacts a TEC aggregator website with information about the content it wants to ingest
b.) The TEC website accepts the web address which I want to import from, in this case https://www.lindahall.org/events, and checks that site for new or updated events
c.) My import job waits for the TEC website to do step b, then it asks the TEC website for the event information which the TEC website just gathered

I wonder if the fact that my Intranet is hidden from the TEC aggregator website is causing a problem? Is there a way to look at a detailed log of what the TEC aggregator import job is doing, that would be very helpful in determining what problem this job is running into.

Thanks

[Cliff]

This reply is private.

[Mark Evilsizor]

Hello Cliff,

It is cool to see that you have access to that level of detail and the aggregator server. But based on your follow up question, I feel like I have not described my process accurately yet. Following is another attempt

* Our site is a WordPress Multi Site Network

* http://www.lindahall.orghttp://www.lindahall.org – this is a publicly available site and it is the source of our events, I believe your servers are able to ingest events from this site as your animated GIF has shown
* http://www.lindahalllibraryfoundation.orghttp://www.lindahalllibraryfoundation.org – this is a publicly available site, I have a scheduled import job which runs on this site and it appears to be working properly
* Inthestacks.lindahall.org – this is our intranet which is only available inside the building, this is the site which is not ingesting properly
* On this site, which tries to import from http://www.lindahall.orghttp://www.lindahall.org, it is only ingesting 3 events and not the 10 it should be
* If I run it live, it brings in all 10, but if I run it from the schedule, it only brings in 3

As part of replying to this email, and due to the earlier trouble we had setting up the TEC Events Aggregator, I decided to wipe the slate clean and try again for this site. I deleted all events (live, trash and ignore) and ran the aggregator, it only found 3 events. I deleted all the events again, and I deleted the scheduled job. Now I created a new scheduled job, the initial run found 10, which it always does when running live. I deleted all the events again (live, trash and ignore), then ran the scheduled job, and it worked as it should, finding all 10 events.

So it seems like all may be well and I was experiencing residue from the time when it was completely broken. I have entered a test event in our source site, http://www.lindahall.orghttp://www.lindahall.org. If that works then all is well and we can close the ticket. I will check tomorrow.

[Cliff]

I’m very glad to hear you got things sorted out. Thanks for your efforts, and sorry it was extra trouble for you.

If something else comes up, feel free to create a new thread.

[Author]

Posts