PDA

View Full Version : Neopets Account Database Suite



j03
03-30-2016, 08:51 PM
Account Database Suite by Infamous Joe

This application collects data and stores it in a local database, letting you view it any time you wish.

[Only registered and activated users can see links]


This is called 'Account Database Suite' by me. It allows you to, using an account (shell or any spare you have), visit Neopets (currently only the NeoBoards) and collect usernames. After that, the usernames collected will be added to the internal database that comes with the program. Your database will store all usernames, and from that username list the program will allow you to visit every username and automatically collect the userlookup details (trophies, avatar/neodeck/stamp count, pet images and stats, etc.) into the database (in text form, so you are not using very much hard disk space!) for viewing at your leisure.

Yes, this program acts very similar to Google's cache system. No, you cannot use this program to out anyone since anyone can edit the database file. I did not encrypt the file for that very reason. :)

Why did I make this program?


I consider this program to be very unique. I've been working on this program for the past few months after coming up with the idea to do this in an application form. Working little by little on it... some weeks, even a month went by and I didn't touch this project... but, I just kept at it and chipped away on the program until now. This is an idea that will definitely branch into other kinds of programs. I feel like it is ready to be published...

When installing: There are two setups in the installer. The first one is quick and will install this program. The second one might take a few more seconds to go through - It is the requirement package for the database!


Program Features:
-) cK Authorization (VIP membership only)
-) Front-end interface to view user lookups
-) All data is stored locally (text-only to save your disk space)
-) Saves most user data including all pet images + stats, avatar/trophy/neodeck/stamp/etc. count, trophy images, and more
-) For safety, browses Neopets in between updating the database
-) Grabs usernames from NeoBoards
-) Optional update user if entry already exists for the day
-) Optional delete user from master user list if frozen/banned
-) Application delay between X and X milliseconds
-) Update a single user for that day
-) Optional save Neopets login
-) Master log displaying program actions
-) Total users in database count displayed
-) Handy progress bar and status label

v1.1.2 Updates:
-) Added "Scrape High Scores" feature. Collect usernames from the high score tables!
-) Displays how many new users are added to your database each time you scrape/import

Program Download:

[Only registered and activated users can see links]

Please post all questions, issues and comments here!

|2eap
03-30-2016, 09:04 PM
import a list of username feature?

is this a local hosted database or something you host?

---------- Post added at 09:04 PM ---------- Previous post was at 09:03 PM ----------

But this is very cool I like the idea of a database, easier to search and sort different queries and specifications

j03
03-30-2016, 09:06 PM
import a list of username feature?

is this a local hosted database or something you host?

It's an SQLite database and it is on your own computer. It's a small file size - only text is stored into it. Everything is quick. This is not an online database like JellyNeo's Item DB, so it's quick to retrieve and submit data.

You can have a text file (each line is a username) and if you import that, it is all added to the DB (unique users only).

------

If you're wondering, running the NeoBoard grabber will fetch about 3500 users. If you then update the database after fetching then you will get all of their lookups saved on your computer - in roughly 5mb? That's extremely small. I am also working on making the data smaller. :)

Maison
03-30-2016, 09:33 PM
This is literally so cool I'm going to rep you

|2eap
03-30-2016, 09:34 PM
This is literally so cool I'm going to rep you

beat you to it! xDDDD

Maison
03-30-2016, 09:43 PM
beat you to it! xDDDD


Whatever major loser xDDDD

I_royalty_I
03-30-2016, 10:01 PM
That's pretty sweet. Gonna give this a go when I get a chance. Definitely something different that I've never seen anywhere else. Good stuff, Joe!

Maison
03-30-2016, 10:23 PM
By the way does it work on macs?! xDDDD

Soredavide
03-31-2016, 05:44 AM
This works phenomenally, took about 2 hours to scrape the neoboards and load the users to the database. Great program and works very quickly after you have the names scraped.

j03
03-31-2016, 06:31 AM
By the way does it work on macs?! xDDDD

If you feel like getting a virtual machine that runs Windows on it.

Soredavide
03-31-2016, 07:55 AM
database size is fairly small 4mb for about 3.5k users (it only saves text).
20369

j03
03-31-2016, 02:16 PM
For people wondering, this is basically like a google cache except it can be edited with any SQLite browser program.

It's not a hack or a cheat... Yet?


Sent from my iPhone using Tapatalk

Vial
04-11-2016, 12:08 PM
i keep getting database locked error, and it crashes turns off :p


NVM: i think i fugured it out, got it working :p, nice program :)

neofreak
04-12-2016, 07:49 PM
Infamous Joe - You said it only pulls from neoboards? Is there any way you can make it pull from the hi-score tables too?

j03
04-12-2016, 09:05 PM
@Infamous Joe ([Only registered and activated users can see links]) - You said it only pulls from neoboards? Is there any way you can make it pull from the hi-score tables too?

Done.

v1.1.2 Updates:
-) Added "Scrape High Scores" feature. Collect usernames from the high score tables!
-) Displays how many new users are added to your database each time you scrape/import

For all users please re-download and install. :)

neofreak
04-12-2016, 09:40 PM
Done.

v1.1.2 Updates:
-) Added "Scrape High Scores" feature. Collect usernames from the high score tables!
-) Displays how many new users are added to your database each time you scrape/import

For all users please re-download and install. :)


You work fast! ;) Thanks!

Bill
04-23-2016, 02:26 PM
Thanks for this Joe, works great!
Would be amazing if you could add an option to grab usernames off of the shopwizard for shops/gallerys.
Would also be cool to add an option to stop the program from pausing since I could care less if my shell gets banned. Great program, thanks comes in handy when finding unregs.

j03
04-26-2016, 06:26 PM
This program will no longer be available for download. I will, however, keep the program online for those that purchased VIP and collected data as the program will now work forever for them (only the database searching for already collected users).

This was a fun project and I am glad it came to life, at least. Cheers! :D

j03
07-28-2016, 11:25 PM
Bump...

SmileYaDead
07-07-2017, 04:10 AM
So this still works for, let's say, my own list of accounts? Or does the captcha mess up it completely? Also, hi Infamous Joe

j03
07-07-2017, 05:41 AM
Bump...

Captcha will make generating new data not possible so only old data that was collected before captchas were put on will work.


Sent from my iPhone using Tapatalk

MadameNova
02-01-2019, 12:43 PM
How long does program take to run?