Weekend Challenge Entry Posts - and Many Others - Missing / Not Migrated from Old Forum

Just in case it is not a presently known issue:

At the moment (May 5, 2018; 7:50 EST), all the Weekend Challenge Entry posts - which also constitute the majority of my lifelong posts at BlenderArtists - are missing.

The primary reason I was a Gold Level contributor in Kickstarter for this migration was to help preserve past posts, many of which contain a great amount of information/tips and even .blend files.

So I hope this can be fixed if it is a problem.

Thanks for all your work on this!

RobertT

UPDATE: as for the ā€œMany Othersā€ (i.e. posts missing) in the updated thread title, please see this post by another user:

1 Like

Hey Robert,

thereā€™s no reason these should have been excluded. Can you tell me where they were supposed to be and provide me a few links to the topics? Links to topics on the old site will do.

Basically all of the ā€œentry threadsā€ are missing. - There is always one thread, where everyone posts their entries and the discussion goes on before the vote and then there is the ā€œvote threadā€ for each challenge.

How can I link to topics on the old site?

Weā€™re waiting to make the old site available so we can look into this. This will only be temporary though - it will be removed eventually.

Bart, here are some recent WC entry thread links I was able to track down using Bing.com (Google already seems to be filtering these pages from their results):

Entries Threads (WC 776 to WC 715) are listed below.

There are many more than that, back to the beginning, and I hope those can be found and added back in.

The bulk of tips and how-to posts I provided in this forum are scattered throughout those entry pages, and many of those posts go beyond Blender-version-specific information (which is to say, even if the posts are old, many of the methods I described are still applicable/relevant).

Best of luck with this!

RobertT

Blender Artists Weekend Challenges

Entries Thread URLS (WC 776 to WC 715; as found through Bing.com):

https://blenderartists.org/forum/showthread.php?449464-Challenge-776-(04-05-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?449114-Challenge-775-(27-04-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?448800-Challenge-774-(20-04-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?448487-Challenge-773-(13-04-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?448162-Challenge-772-(06-04-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?447850-Challenge-771-(30-03-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?447526-Challenge-770-(23-03-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?447161-Challenge-769-(16-03-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?446876-Challenge-768-(09-03-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?446548-Challenge-767-(02-03-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?446097-Challenge-766-(23-02-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?445717-Challenge-765-(16-02-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?445333-Challenge-764-(09-02-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?444878-Challenge-763-(02-02-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?444496-Challenge-762-(26-01-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?444107-Challenge-761-(19-01-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?443756-Challenge-760-(12-01-18)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?443334-Challenge-759-(05-01-18)-Entries-OPEN

https://blenderartists.org/forum/showthread.php?442993-Challenge-758-(29-12-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?442712-Challenge-757-(22-12-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?442374-Challenge-756-(15-12-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?442006-Challenge-755-(08-12-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?441679-Challenge-754-(01-12-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?441376-Challenge-753-(24-11-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?441021-Challenge-752-(17-11-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?440642-Challenge-751-(10-11-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?440279-Challenge-750-(03-11-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?439958-Challenge-749-(27-10-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?439597-Challenge-748-(20-10-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?439260-Challenge-747-(13-10-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?438945-Challenge-746-(06-10-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?438565-Challenge-745-(29-09-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?438229-Challenge-744-(22-09-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?437780-Challenge-743-(15-09-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?437399-Challenge-742-(08-09-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?437056-Challenge-741-(01-09-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?436677-Challenge-740-(25-08-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?436277-Challenge-739-(18-08-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?435930-Challenge-738-(11-08-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?435563-Challenge-737-(04-08-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?435183-Challenge-736-(28-07-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?434654-Challenge-735-(21-07-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?434348-Challenge-734-(14-07-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?433905-Challenge-733-(07-07-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?433424-Challenge-732-(30-06-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?433057-Challenge-731-(23-06-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?432634-Challenge-730-(16-06-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?428113-Challenge-729-(09-06-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?427301-Challenge-728-(02-06-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?426554-Challenge-727-(26-05-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?425815-Challenge-726-(19-05-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?423754-Challenge-725-(12-05-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?421301-Challenge-724-(05-05-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?420849-Challenge-723-(28-04-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?420457-Challenge-722-(21-04-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?420062-Challenge-721-(14-04-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?419633-Challenge-720-(07-04-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?419202-Challenge-719-(31-03-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?418733-Challenge-718-(24-03-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?418186-Challenge-717-(17-03-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?417722-Challenge-716-(10-03-17)-Entries-CLOSED

https://blenderartists.org/forum/showthread.php?417234-Challenge-715-(03-03-17)-Entries-CLOSED

1 Like

Helge does keep a list of Weekend Challenges links for the Voting threads of all previous WC themes:

https://geoxis.de/blend/themes.htm

But no WC Entries thread URLs are there.

I also noticed Archive.org / WayBack Machine links do not seem to have archived any of the WC entries content, so I dearly hope this important part of BlenderArtistsā€™ history can be rescued and preserved.

RobertT

@pfaffman hereā€™s another issue with some missing topics. Can you look in to this as well please?

I donā€™t know whatā€™s up with this. I spent literally a week working only on getting the formatting of these topics as good as possible.

Iā€™ll see what I can find.

1 Like

My current guess is that these topics were created by a user with an invalid email address. There is code that generates a valid email address so that those users get created anyway, but some upgrade broke it. I modified the code so that those users do get created, so those users should exist, but thatā€™s my current best guess.

Iā€™m downloading the database to my local machine to see what I can find now.

But itā€™s wrong.

Check with @Helge , he created both the entry posts that are missing and the voting posts, that got transferred. - He used some script to create the voting posts afik, maybe that has something to do with it? - Just guessing of course. :wink:

1 Like

Thanks for looking into this.
One short question: Would it be save for me to just create a new entry thread, now? Or would this cause problems in case you would ā€˜reimportā€™ the original WC sub-forum threads?

Btw. some old entry threads seem to have survived the migration.
E.g: Challenge #608 (13/2/15) Entries OPEN

One thing I just noticed:
The threads that did get migrated, do seem to be based on a previous/older state of the database.
For example I renamed the last voting thread to ā€œChallenge #775 Voting CLOSEDā€. But it is called ā€œChallenge #775 Voting OPENā€ right now. Apart from that, at least one post seems to be missing in that thread. DM9 mentioned the car entry being used as a splash screen of BforArtists: ā€œThe classic car also made it to the splash screen of the latest BforArtists release. :Dā€. (including a screenshot: Attachment 523159 (https://blenderartists.org/forum/attachment.php?attachmentid=523159)
This post doesnā€™t seem to be there anymore.

It would be fine. The importer sticks a custom field in that ties stuff to the old database. It will ignore your new posts.

It seems like all of 2017 and most of 2018 is whatā€™s missing.

Iā€™ve tried re-running the script for posts since 2017-01-01. That didnā€™t help. I looked for some kind of clash with post/thread IDs, and donā€™t see anything.

That is to be expected for posts changed since the last import ran. The importer ignores what itā€™s already imported. We started an import about 8 days ago and then froze the forum and ran it again with the new data on Thursday/Friday (depending on time zones).

I see the missing posts in the database, though. I still donā€™t have an explanation.

Could the missing posts be exported on their own from the old forum and then merged from that separate instance into the new forum?

Perhaps that would help fill in some missing requisite data the current forum expects (and/or filter-out irrelevant data the new forums deprecates/discards)?

Iā€™m, concerned yet remain hopeful =)

RobertT

1 Like

I found the problem, though I do not understand it. Somehow, the code that was replacing links to local topics was calling a function that never returned, causing any topic or post that contained

FORUM_URL/showthread\.php\?(\d+)-([^\"\[\]]+?)[#post(\d+)]*

not to be imported. And if a topic doesnā€™t get imported, its posts canā€™t get imported.

I think thatā€™s 15,295 topics, which is 3.6%. Making matters worse, we know that some of those topics are among the most important.

Iā€™ll work with @bartv over email to figure out how to move forward.

3 Likes

YeaY ā€¦ - ([^"[]]+?) - might become my new username. ^^ ā€¦ Good luck!

1 Like

Thereā€™s a certain strange comfort knowing the problem is widespread, kind of like going to downforeveryoneorjustme and hearing itā€™s not ā€œjust youā€ :slight_smile:

Hopefully this means a solution must and will arise, since so much stands to be lost otherwise.

We are rooting for you!

Another thought on this overall situation:

Since Archive.org apparently did not save much, if any, of the previous forum, Iā€™m wondering if the new Discourse format will be more Archive.org - friendly, or if it can be made to be so (e.g. by not using robot exclusion protocol).

The forum is very much like an invaluable research database and even a sort of history maintainer (of Blender and its users) that, when not available, it is far more than just an inconvenience but rather a significant absence of a critical service.

So, having some sort of ā€œoff-siteā€ backup of that, be it at Archive.org or somewhere else, would be great.

It took so many years to get to where we are with this forum, with Blender, with our projects, and with our community, and I think itā€™s all so worth protecting and preserving, for us and for others, and for Blender.

1 Like

re:

Just for fun, I tried that regular expression in Ubuntuā€™s gedit, and it only highlights (when examining through search/replace in regex search mode) a portion of the entries URL as is.

If that last character in the regex is changed from * to .*, then the rest of the URL gets matched in my test.