April 15, 2022 at 9:44 PM
File type : Multiple folders containing JSON files
File size : 4gb compressed (~30gb uncompressed)
Date : (fairly recently I guess..early 2020)
Source : RF
My little project now is trying to work out a possible solution to making the file accessible through a database
Hope MySql is a good start.
Converting to csv with python would have been an option but...I'm going database :D
Will post more sample when I get to my pc
File size : 4gb compressed (~30gb uncompressed)
Date : (fairly recently I guess..early 2020)
Source : RF
My little project now is trying to work out a possible solution to making the file accessible through a database
Hope MySql is a good start.
Converting to csv with python would have been an option but...I'm going database :D
credits: RF user that posted (forget the user)
Data from the first file
[
{
"address": {
"city": "HICKORY",
"state": "KY",
"street": "3919 STATE ROUTE 301",
"zip": "42051"
},
"age": 22,
"aka": [
{
"firstname": "ABBY",
"lastname": "PADGETT",
"middlename": "A"
},
{
"firstname": "ABBY",
"lastname": "SPENCER",
"middlename": "A"
}
],
"autos": [
{
"make": "TOYOTA",
"model": "COROLLA",
"year": 2011
}
],
"court": {
"judgements": true
},
"dateOfBirth": "1996-04-08",
"dateOfDeath": "1997-12-18",
"education": {
"educationLevel": "High School"
},
"emails": [
"[email protected]"
],
"firstname": "ABBY",
"gender": "F",
"id": "5c6e3ed2d20c6db42860a479",
"jobs": [
{
"title": "Student"
}
],
"lastname": "BRYANT",
"middlename": "A",
"pastAddresses": [
{
"city": "Billings",
"dateRange": {
"endYear": 2013,
"startYear": 2010
},
"loc": "45.7813,-108.5727",
"state": "MT",
"street": "3909 Swallow Ln",
"zip": "59102"
}
],
"phone": "7326951761",
"politicalParty": "Republican",
"professionalLicense": "NURSING",
"profilePics": [
{
"url": "https://media.licdn.com/mpr/mprx/0_YSs4eLVFQfq_ou1wVDo9IXMFGfE_mmPwVJXvmkwWWwIhW73LZgRq2mTCzRj"
},
{
"url": "https://graph.facebook.com/1179099847/picture?type=large"
},
{
"url": "https://s-media-cache-ak0.pinimg.com/avatars/booth_abby-12_140.jpg"
},
{
"url": "https://lh4.googleusercontent.com/-EPRX48-Rp8A/AAAAAAAAAAI/AAAAAAAAAAA/Te7uAkwYeuE/photo.jpg"
},
{
"url": "https://media.licdn.com/mpr/mpr/shrinknp_400_400/p/8/000/272/397/1e30b4b.jpg"
},
{
"url": "http://media.licdn.com/mpr/mpr/p/8/000/272/397/1e30b4b.jpg"
}
],
"race": "Caucasian",
"religion": "Christian",
"social": [
{
"domain": "facebook",
"url": "https://www.facebook.com/abbywonwon"
},
{
"domain": "linkedin",
"url": "https://www.linkedin.com/pub/abby-shroyer/53/a92/605"
},
{
"domain": "facebook",
"url": "https://www.facebook.com/people/_/100000628123662"
}
],
"title": "MS"
}
]Will post more sample when I get to my pc
