in house dollar bill thumbnail
Comic Book Plus In-House Image
 Total: 43,546 books
 New: 87 books




small login logo

Please enter your details to login and enjoy all the fun of the fair!

Not a member? Join us here. Everything is FREE and ALWAYS will be.

Forgotten your login details? No problem, you can get your password back here.

(2nd March 2008) Update on last few weeks and current situation!

Pages: [1] 2 3 ... 5

topic icon Author Topic: (2nd March 2008) Update on last few weeks and current situation!  (Read 89669 times)

Serj

  • VIP

Hi everybody and welcome back to the site. We are now back up and running but not back to 100%.

The site went down due to an operating system issue which was unexpected. It took down all the sites database with it and nothing was recoverable. Luckily I had all the files so all the files are on our new server but the problem lies that the database used to restore the forum and download database is nearly a year out of date. This has caused the following problems:

1. Anyone who has registered does not have an account anymore and will need to register again.
2. Anyone who has been given VIP access or donated has no VIP account.
3. Any files added in the last year were not listed in download database.
4. Categories added in last year were missing.
5. All files that were missing have the uploaders name as goldenagecomics.co.uk

Sooo this is what I have done or propose to overcome these issues.
1. If you do not have an account you will just need to register and activate your account, sorry about this but only way about it.

2. If you was given VIP access by aussie as an uploader please contact me or aussie500 again and you will be given VIP status. If your a donator please send me a PM or email  with your paypal email addy you used when sending the donation so I can verify your account and add you back to VIP section. (DO NOT SEND ANYONE ELSE PMs ABOUT DONATIONS AS I HANDLE THIS)

3. Way our download script works is when a file gets uploaded its renamed to a randomly generated filename and extension as a security feature and so no one can guess the url to files and download/rip them easily. This presented a problem when 80GB of files were not on system and I was left with files I did not know contents of. I spent the last week adding these files to the download script via the aid of 2 little programs I wrote in php and Visual Basic.

I have done following:
* First to find our what rough contents of each random named file is my VB program just opened each file and read the first file inside. This was great for files containing imaged named: comic name issue 5 page 4.jpg as it made more sense but some contained image names like 00.jpg which tells us nothing what comic is.
* Next I took these filenames and built a php script to auto insert all the files into the unsorted category. So if you check out that category you will see over 1000 files. They need to be renamed, edited, added to new categories and the ones with filenames like: 0000 etc need to be downloaded and their correct filename verified.

As this is a community I am asking if anyone wants to help out in the sorting process? If you do post here and all trusted members will be given mod access on the site to carry out these edits etc. If any members spot any problems or download a file named incorrectly please report it on the forum so it can be edited.

4. I have manually added all missing categories by hand via the aid of google cache but some category images are missing and need to be edited over time.

5. If you know you have uploaded a file and want your name back as uploader let us know and we will edit it.


I know all this is a right pain in the a$$ but least we have all our files intact and least the site is back up in one form or another.
Forum looks very old currently so start your posting and lets fill the site back up again.

We have also now taken steps to make sure this doesn't happen again. We use to take file backups as well as database backups but back last march it seems the database backup script stopped working and I should have noticed this but I never did. I now have a new system which backs up files and databases to another server and my PC and if it fails I will know about it so I've made sure this problem never causes so much hassle to site.
« Last Edit: February 23, 2010, 08:34:12 AM by Yoc »
ip icon Logged

boox909

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #1 on: March 02, 2008, 05:14:23 AM »

Serj,

Thanks so much for your efforts.  ;D ;D ;D

I appreciate all that you and everyone has done.

I am willing to help out as a moderator with sorting.

Folks, I am looking at this as a new birth for GA-UK which will make the site
stronger and better in a brief time.

Let's not forget to give thanks for Serj's efforts at getting things back on track.

Boox  :D
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #2 on: March 02, 2008, 05:33:55 AM »

Also for all donators who were set up to donate monthly automatically via the site. You will need to re-donate to set it back up because as far as I can see there are not donators in the auto database.

For steps on how to donate please see below:


ip icon Logged

citaltras

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #3 on: March 02, 2008, 07:43:58 AM »

Happy so see this site back again and that at least all the comics files are still there.
Seems that my account is untouched.
I am willing to help sorting if needed.
Actually, when the server went down I was in the process of downloading and storing month by month
the comics uploaded since last July. I started from December 2007 and went back in time. I was able to burn 3DVDs containing the months from mid September to December 2007, before the server crashed.
ip icon Logged

phabox

  • VIP & JVJ Project Member
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #4 on: March 02, 2008, 12:04:07 PM »

Glad to see things getting back to normal :), a BIG "Thank You" to serj and the team for putting in the time to get back online.

Like many things its only when they are no longer around you relalise just how important they are to you.

I was really missing my daily visits to the site to see what new books had turned up and check the messages to see what the lastest "hot" topic was and somehow my life seemed less exciting with the site down,...Sad or what ?

Wish I could be of more help but sadly I lack the IT Knowhow to be much good here and I have a low paying but fullfilling job working with special needs kids so don't have much in the way of spare cash to splash about otherwise I would be more than happy to send some of it in this direction  :(.

The GOOD NEWS is that I still have a good few unscanned Golden Age books left over from my ' richer times' and have dug a couple of these, Plastic Man_050 and Crack Western_084 to scan over the next couple of weeks so I like to think that I am still "doing my bit" for the site.

Best Wishes,

-Nigel/"Phabox"
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #5 on: March 02, 2008, 01:46:53 PM »

For all donators ill hopefully have a script online so you can fill in your username/paypal email addy and if its in history of paypal transactions made in the past it will auto set up you as a VIP.

My plan is to make this script within next 24 hours once paypal send me history logs for all transactions and script will be manual so all past doantors will need to enter their details into it to confirm them against recrods. Theres no point me making script automatic and check registered accounts as half the donators do not have accounts currently.
ip icon Logged

John C

message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #6 on: March 02, 2008, 02:02:17 PM »

Excellent work under terrible conditions, Serj.

For the filenames, I have a possible suggestion that might help move things along:  If someone generates a list of, for example, MD5 hashes of every file, you can compare the hash values to the files you have.  Wherever they match, rename one file to the next.  (Create two hashes/associative arrays/whatever your language of choice calls'em, and insert each filename by key, then output "rename <garbled name> <original name>" for each MD5 value.  Then run that file as a batch file or shell script, obviously depending on the operating system.)

I'll gladly volunteer on my end, but I've renamed a lot of files for consistency's sake--usually, that means simplifying the title ("Hit" rather than "Hit Comics"), removing the dates and company name, and often the scanner's name--so it might be smarter to use someone else's archive.

Again, thanks for getting this back into shape.  I don't even want to think about how much time it must've taken to rebuild!
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #7 on: March 02, 2008, 02:05:05 PM »


Excellent work under terrible conditions, Serj.

For the filenames, I have a possible suggestion that might help move things along:  If someone generates a list of, for example, MD5 hashes of every file, you can compare the hash values to the files you have.  Wherever they match, rename one file to the next.  (Create two hashes/associative arrays/whatever your language of choice calls'em, and insert each filename by key, then output "rename <garbled name> <original name>" for each MD5 value.  Then run that file as a batch file or shell script, obviously depending on the operating system.)

I'll gladly volunteer on my end, but I've renamed a lot of files for consistency's sake--usually, that means simplifying the title ("Hit" rather than "Hit Comics"), removing the dates and company name, and often the scanner's name--so it might be smarter to use someone else's archive.



Thats a good idea :)
Again, thanks for getting this back into shape.  I don't even want to think about how much time it must've taken to rebuild!
« Last Edit: March 02, 2008, 03:07:33 PM by Serj »
ip icon Logged

Lanfeust

message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #8 on: March 02, 2008, 02:47:41 PM »

Finally back! Thank you very much for having made it - I was missing this website! If need be, I can provide the comics I downloaded if they're not recoverable from the database. I'll check on my PC to see what I have.
ip icon Logged

Yoc

  • Past Member
  • avatar for old site member: Yoc
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #9 on: March 02, 2008, 03:09:06 PM »

It's Aliiiiiiiiiiive!   :o ;D
I'm willing to help restore the files as a moderator if needed.

-Yoc
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #10 on: March 02, 2008, 03:16:42 PM »

All files that were not in the database back in March 2007 are currently in the unsorted category. So no new files are needed to be uploaded. All we need are a group of users to slowly go through files, rename the title and add a description etc and then move them to a suitable category.

I do like the idea about MD5 hashes thou so i'm looking into that now and if so chances are ill create a small little windows program that will collect all md5 hashes of the renamed random filenames I have and then if few users who have most of files can also run it and results when compared will show what md5 hash corresponds to a more user friendly filename etc plus also can get filesize as currently all unsorted files have a filesize of 0mb which isn't great for a website that tracks people downloading files per mb etc
ip icon Logged

kolchack

  • Past Member
  • avatar for old site member: kolchack
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #11 on: March 02, 2008, 03:17:58 PM »

i cannot register to 'goldenage comics uk' site because, strangely, there is no link on the site to do so ... please help.
ip icon Logged
Comic Book Plus In-House Image

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #12 on: March 02, 2008, 03:22:01 PM »


i cannot register to 'goldenage comics uk' site because, strangely, there is no link on the site to do so ... please help.


Your forum account is your download comic site account. So login with your forums username/password.
ip icon Logged

narfstar

  • Administrator
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #13 on: March 02, 2008, 03:24:25 PM »

I re-registered.  Just check the scans to know that narfstar has uploaded just a few files  ;D
I also donated so need to be up to VIP.  JIM
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #14 on: March 02, 2008, 03:29:52 PM »


I re-registered.  Just check the scans to know that narfstar has uploaded just a few files  ;D
I also donated so need to be up to VIP.  JIM


VIP status updated. Sorry about losing your account :)
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #15 on: March 02, 2008, 04:51:38 PM »

As per jcolag suggested about MD5 hashes of peoples comic files downloaded here to compare among ones that need renaming I have built a small little Windows Application that goes through a folder and takes hashes of all .cbr/.cbz/.zip/.rar files and outputs them to a log file. I am currently testing the application before I hand it out to few people with big list of files.

The plan is as follows:
1. I run program and get a hash list of all files that are currently in unsorted group with rogue names etc.
2. Users who have alot of the files run the hash list also on their comic folders and generate their own list and output the log file containing filename, hash, filesize
3. Users send/upload the log files to me in the original format generated by the program I've written.
4. I use the log files send to me to compare with my log file using another application I got and if md5 hashes match it updates the database with the valid filename and filesize making the future job much easier.

If anyone want to help out with above let me know and when program tested I'll pass it on to you.

Problem with program currently is MD5 hashes take a while to generate using it due to big file archieves and program is not currently recursive so it only stays in folder it selected to scan. So I might update it now so you can select your entire Golden age comic folder and scan all of them instead of having to select every folder you save your files to etc.
ip icon Logged

Yoc

  • Past Member
  • avatar for old site member: Yoc
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #16 on: March 02, 2008, 05:15:44 PM »

Sorry Serj,
I rename, tweak, etc almost all of my downloads so I can't help with your hash list plan.

-Yoc
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #17 on: March 02, 2008, 05:40:40 PM »

Yoc, I'm not too fussed what the filenames are as its better than what we have currently :) So post an example of your filename format currently.

Alot of the files in unsorted are random names or blank so as long as they have the comic name and issue I would be 100% happy.
ip icon Logged

Geo (R.I.P.)

  • VIP & JVJ Project Member
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #18 on: March 02, 2008, 07:00:40 PM »

Serj it's so good to see that the site back up. Just waiting on getting my VIP status back so I can start uploading some new comics to add to the site. Thanks for all your hard work on this.

Geo
ip icon Logged

BAY575GOLDENAGE

  • Past Member
  • avatar for old site member: BAY575GOLDENAGE
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #19 on: March 02, 2008, 07:21:41 PM »

WELCOME BACK!

thanks for all the hard work done already Serj.

ready to roll up sleves and pitch in if i can.

ip icon Logged

citaltras

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #20 on: March 02, 2008, 09:09:31 PM »

I also modified some of the files,
unpacking and reducing size for large cbr files using irfanview,
or unpacking corruot zip files and packing again.
I don't have downloaded all of the files, perhaps 65-75% of them.
How many files do you have to rename and sort?

ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #21 on: March 02, 2008, 09:29:10 PM »

1980 files need to be sorted and renamed lol
ip icon Logged

Serj

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #22 on: March 02, 2008, 10:24:16 PM »

File sizes of the unsorted files are being added. So no longer when downloading one of those files will you see downloading unknown size file in your browser.
ip icon Logged

Yoc

  • Past Member
  • avatar for old site member: Yoc
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #23 on: March 03, 2008, 02:13:21 AM »

Hi Serj,
Actually I meant if you were to say give me this hash file application my own numbers would be very different from your own so short of me downloading a file, looking inside and trying to figure out what it was I'm not much help.
I DO think the hash file idea is a great one IF someone out there has the original files as posted on the site.

So if you still wanted to give me or others in my position moderator status with the ability to rename and move files around on the site I'm still willing to help out.

My own files are sorted by Publisher -Title -Issue# -Date -if it's in fiche -anything special of note/artists info -Page Count -Missing pages if known -and finally Scanner when known.

ie- found in my Centuar folder: Amazing-Man 07 [Nov'39][FICHE][Burgos,Everett]-68pg-c2c     -Rolster scan

Feel free to PM me with specifics if you'd like my help.
-Yoc
ip icon Logged

shipshape

  • VIP
message icon
Re: (2nd March 2008) Update on last few weeks and current situation!
« Reply #24 on: March 03, 2008, 02:19:52 AM »

Thanks Serj for getting the site back up. you do a great job.
ip icon Logged
Pages: [1] 2 3 ... 5
 

Comic Book Plus In-House Image
Mission: Our mission is to present free of charge, and to the widest audience, popular cultural works of the past. These are offered as a contribution to education and lifelong learning. They reflect the attitudes, perspectives, and beliefs of different times. We do not endorse these views, which may contain content offensive to modern users.

Disclaimer: We aim to house only Public Domain content. If you suspect that any of our material may be infringing copyright, please use our contact page to let us know. So we can investigate further. Utilizing our downloadable content, is strictly at your own risk. In no event will we be liable for any loss or damage including without limitation, indirect or consequential loss or damage, or any loss or damage whatsoever arising from loss of data or profits arising out of, or in connection with, the use of this website.