Organizing Synology NAS

Organizing Digitally – The NAS

Ramen Junkie No Comments

I want to do a sort of series about how I have my digital world organized but I was sort of trying to decide the best place to start. I wanted to run down some file structure methods, and I want to run down Office 365 use, and previous backup methods, but ultimately, the core of everything, is my NAS.

So this is also sort of a followup to that last set of articles about my Synology NAS. I am sure there are other ways to do a lot of what the Synology does, but there are a lot of simple to use built in features that are nicely integrated into my workflow. It’s a little pricey to set up initially, with the box and the drives, but the reality it, any good solution will be.

Features I Use

These aren’t in any particular order, but I wanted to touch on the aspects of the NAS that I use pretty regularly.

  • OpenVPN – I used to go to a lot of hassle opening up firewall ports on my home network to different devices and machines, so I could access web cams or SSH to different servers and blah blah blah. This is a bit of a security problem, since it means lots of open target points as well. I’ve long since dumped that in favor of OpenVPN, which is built into the NAS. I connect through my laptop or my phone to my home network, then I connect to whatever network drive or SSH connection I need to. It works perfectly and requires way less hassling with the firewall.
  • Download Station – This is essentially a Tor downloader, though I think it can handle a lot of other url types. I don’t really directly interact with this, I keep a folder for incoming files that I occasionally sort and a watch folder for Torrent files that it pulls from. The fun part is syncing the watch folder using One Drive, so I can dump Torrent files to it from anywhere. And for what it’s worth, I don’t use this for piracy, primarily I use it for downloading Humble Bundle purchases. A bundle often has 20+ items, so I will bulk download the torrents (to save HB some bandwidth) and then dump them into the watch folder.
  • Video Station/DS Video – I tried running Plex for watching digital movies from the NAS but it was flaky as hell since there isn’t an official Synology app and Plex is increasingly pushing their subscription nonsense instead of just being a client/server self hosted application. Fortunately, there are Synology Apps for Fire TV (Which I use for streaming on both TVs). So I’ve sorted all of my home movies into the Videos folder and (for a future blog post) encoded them to be easily accessible and compatible.
  • Photo Station – Ok, I don’t actually use this… yet… but I want to revisit it going forward. I want to do a separate post on photos with more details, but basically, I wasn’t using the Photos folder for backup purposes, and that situation has changes recently.
  • Audio Station – I have a ton of music from different sources compiled and sorted together. It’s not my primary GoTo for music, but I want to get more organized playlists going so I can more easily use this for playing my music. For the most part, I am fine with just sticking music ON my phone though.
  • Mail Station – I don’t use Mail Station for actually sending emails, but I did set up the Mail Station server and I use it as a deep archive of emails. I essentially have all my email I have ever sent, going back to the 90s, pulled forward through various email clients, and now it’s all dumped into a Mail Server in a sorted, searchable archive.
  • Cloud Sync – Cloud Sync lets you hook your Synology to various cloud drive services and sync them to your local drives. I’ve got several Dropbox accounts that I have used in the past (Personal, server syncing, each family member) and now a couple of One Drive accounts for backup and personal document sync all linked. It even does Google Drive.

Features I Stopped Using

There aren’t a lot of features I have stopped using, but there are a couple.

  • Web Station – The Synology comes with an optional Webserver and a weird WordPress system that can be enabled. This has been weirdly buggy since day one and I already have plenty of experience managing LAMP stack servers. I recently disted off one of my older Pis, set it up with WordPress and moved the primary use I was using the Synology Web Station for to the Pi. Mostly, It was just a WordPress Archive of all of my old blog posts from various blogs. The links were weird and didn’t work properly because it didn’t quite understand subdirectories or something. The images were present but they didn’t always work because they pointed to old URLs and working the SQL system to change them always came off as wonky. Basically, I didn’t need this archive to be on the NAS and it was an easy thing to just offload to another device.
  • Cloud Station Server – This is a back up system for devices and computers. It will sync specific local folders to a folder on the NAS as a backup. Maybe I was doing something wrong but it always felt really flaky as well, so I just sort of stopped using it. I had it on every laptop in the family for a while but as laptops were replaced, then things started getting weird and getting others to grok how to pull back their files wasn’t super easy either. The better solution I have found is to just give everyone a shared folder specific to them that they can shove files they want to keep into. For my personal use it was just redundant because my entire workflow for years has essentially been cloud based with Dropbox or One Drive keeping everything backed up by default.
  • Surveillance Station – I still sort of use this, but all of my webcams died except one, which doesn’t have night mode anymore. So, it exists and I would use it, but I don’t really use it much anymore. Also. frankly, there was never anything worth seeing on the recordings.

Workflow

The real workflow from the NAS comes from shared folders. Everyone has access to the Family Photos folder mapped to their laptops. I created a shared folder for all of the Blog graphics my wife was using for her blog work that everyone can access since my daughters both helped her with that. They use a shared drive for all of the Ebay and Mercari photos they work on.

I keep folders for photos, and videos and ebooks. I keep folders for important family documents like Tax Returns. All of this can easily be synced to a backup in the cloud and I have a couple of USB keys and loose drives that I do periodic manual backups to, that get stuck in a fire proof safe.

It also lets me map other network drives in as well, for shuffling files around. I have a whole second Linux box set up that has another 4TB or so space in it across several drives, that I use to store less important files like Installable programs and games, ISOs, temporary files for video editing projects, a mountain of internet memes and images saved over the years, music concerts I’ve downloaded, etc. Plus I can map things like, the web root for my Raspberry Pi, or set up a one way(ish) SSH tunnel to my Webserver for pulling backups through.

The box itself sits behind the TV upstairs, and if there ever was a fire or something, it’s likely one of the things I might try to grab on the way out the door, but I’d like to thing my system is robust enough that even if it were lost anything important would be recoverable.

Organizing

Organizing Eternally

Ramen Junkie No Comments

For the past few years, I have been in a pretty hard core “Organizing mode” on a lot of various fronts. It honestly feels like an endless uphill climb because there is just so much and it doesn’t help that I am constantly adapting and updating the methodology. Some of these topics are ones I will likely touch on in more detail in the future, especially the technology related ones, but I wanted to run over a quick list. This is partially for my own sanity.

Physical Organization

Part of this involved The Basement upgrades, which aren’t really complete but they are at a good stopping point. Most of my physical stuff is pretty well organized, for the most part. The basement has a second half that’s a little jankey that we use for storage. It’s lined with totes for various holiday decorations and winder clothes, and one corner is all of my stuff I don’t have room to display or use, sorted into a bunch of shoebox sized totes, along with a bunch of boxes in larger totes. I’ve thinned out a lot of my extra electronics over the years. I’ve started thinning out some of my video games stuff as well, often because I have PC versions or even just newer versions on newer consoles.

Having a toy collection requires a fair amount of organzining. For example, I use these tackle boxes to sort out the accessories.

For import figures, I generally give each figure it’s own cubby, bot things like Marvel Legends, I have entire sections for alternate heads and hands. I’ve got effect parts sorted, missiles sorted, transformer guns sorted, I have one that’s all 4″ scaled parts. I have a different organizer that’s just 1/12th accessory parts I have collected over the years for use in photos.

Photos

I want to do an entire post just for photos. I take an enormous amount of photos. It’s slowed down now that my kids are all adults, and there is less going on, but just a quick check suggests I have at least 250,000 photos or 160 gigabytes of data.

Photos of school and family events, photos of projects, photos of toys, just tons and tons of photos. Half of these photos never get used or posted anywhere but they are meticulously organized.

I am also slowly working on scanning in old photos from my own photos to my parent’s photos to my in law’s photos.

Video

I also have a lot of video files. And not just movies and TV from the high seas. I honestly don’t really have a ton of that to start with, you can pretty much just get everything somewhere on streaming these days so why bother. But family movies. I’ve had several digital video games over the years, and at least one Professional Panasonic camera I used to do Professional video production (IE, I got paid for it). Video takes up a lot more space than photos though, so I’ve been working on converting a lot of that down. Video will probably also get it’s own post.

Files in General

Another topic for discussion I want to cover that I have been sorting is files in general. I’ll admit, it’s a bit of a problem, but digital storage is cheap, and I save a shitload of files. From random memes, interesting landscapes, photos of toys others have taken, news clippings, hot-to articles, and other web stuff, to my own files. I’ve got files I’ve moved forward from floppy disks to zip disks to CD-Rs to modern day that were writings or drawings or even custom levels for super old DOS games.

Backup Strategies

I also do my best to keep a fairly robust backup system for the things I’d rather not lose (mostly family photos and important documents). Some of which I have had to update recently due to software changes by certain companies (Amazon no longer working with Synology).

A lot of the systems are similar, but I want to go over some of my general organizing techniques in the near future because it’s something that’s been on my mind a lot for a while now. It also works pretty well, for the most part, especially now that I am caught up.

Listening Habits

My Music Listening Habits for 2020

Ramen Junkie No Comments

Yeah, those monthly updates were kind of bleh, so I dumped them. But I still want to do a yearly wrap up. Though overall there isn’t a lot that’s surprising to me about the yearly stats.

The year was dominated by most of the artists I would expect it to be dominated by. Sigrid, Tessa Violet, Aurora, CHVRCHES have 14 of my top 25 albums. This grid doesn’t even include a few additional Sigrid “Albums” of live tracks that don’t properly show up so they get filtered.

Anyway, a bit better breakdown…

I am actually surprised that Sigrid still topped the chart above Aurora. I’ve been listening to a TON of Aurora, and not just “recently” or something, like all year. Plus Sigrid hasn’t had anything new since November 2019, so I felt like I had been listening to her music less. I still had around 100 more scribbles on Sigrid than Aurora. Tessa Violet, I’m less surprised about. I’ll comment a bit more later, but Tessa Violet has kind of dominated my individual song listens, she just… has less songs.

CHVRCHES has been kind of slowly building up more and more in rotation, and I expect them to continue to come in pretty high going forward as well. Another sleeper to look out for next year will be Dodie, at number 13. She only has a handful of tracks, and I’ve only recently started listening to her, but I really like her music, and next year, she has her first full album coming out.

On the “falling” list, I’ve hardly been listening to Alice Merton and Kiesza lately. Nothing wrong with either, they just sort of, have fallen off the rotation. And despite both ranking high, Dua Lipa and Carly Rae Jepsen were never really in the rotation. I’m honestly not sure how either is so high.

There are also a few of my more mainstay artists making a showing. The Who, BT, Pink Floyd, Avril Lavigne, Alanis Morrisette, Taylor Swift. I’m a little sad that Raffaella only really had one new song recently. She was the opening act for Sigrid when I saw them in 2019 and I really like her music. She has put out one track, Bardot, and a collaboration track called On the Look Out, that may as well just be a Raffaella track.

My single top track for the year, is, without question, the “2020 Anthem” of Bored.

Granted, this track is older than 2020, but it got a music video in 2020, and it kind of just sort of… fits the feel.

Half of my top ten were Tessa Violet tracks, so like I said, she kind of dominated on an individual track list. Everything else is about as expected, though I would have thought more Aurora tracks would have made the cut for that top 20.

Anyway, if you want, you can always just follow me on Last.fm.

Advent of Code

Advent of Code 2020 – Wrap Up

Ramen Junkie No Comments

Well, my desire to complete this totally fell apart about halfway through. I managed to get around 25 out of 50 stars total for the 25 days of tasks. I two started 11 of the 25 days, and one stared 3 more.

There are a myriad of reasons for failing to finish all the tasks. For starters, I started to have a few one star days that I would “get back to”. Most of these I have a good idea of how to solve them, but there are little problems somewhere that are stopping me from solving them.

I also just got busy/bored of it. After Day 17, I just kind of got tired of it. I also started being busier with life activities like the holidays and Doctor appointments for my wife, and just didn’t have the energy to bother. I did check on what a few of the other later tasks were and have some ideas on how to go about completing them, but it just all became too tedious.

I’m not a professional programmer, so every tasks just becomes this uphill slog and int he end, they don’t run very quickly or great. Meanwhile people are posting their one line trick code work on Reddit. I know it’s not that kind of competition, but it still kind of drags my motivation down.

I may come back and finish things up, but for now, I am still pretty good with getting half the stars.

Advent of Code

Advent of Code 2020 – Day 15

Ramen Junkie No Comments

Hey look, Day 15 is another one that took a super long time to calculate, though it was one of the easiest to code. It’s a fancy memory game, for Elves who apparently have computer brains. You start with a series of numbers, then the next number you say, is the difference between when the previous number was said, the last two times.

For example if you start saying this sequence, with 0,1,2,3 , the next number is 0, because 3 has only been said once, after that it’s 4, because 0 was said as the 5th number and the first number (5-1). After that it’s 0 again, because 4 has not been said before, then it’s 2, because 0 is at 7 and 5 (7-5), following that is 5, because 2 is at position 8 and 5 (8-5), and so on.

Both parts were the same problem, just with a different number of iterations, 2020 and 30,000,000. Calculating the 2020th number was quick, calculating the 30 millionth number, not so much.

Anyway, here is my code:


values = [0,8,15,2,12,1,4]

current = 0


while current < 30000000-7:
  check = values[-1]
  last = len(values) - values[::-1].index(check)
  if check in values[:last-1]:  
    temp=values[:last-1]
    temp.reverse()
    #print len(values)
    sec_last = len(values) - temp.index(check)-1
    next = last-sec_last
  else:
    next = 0
  values.append(next)
  #print next

  #print len(values)
  current+=1

print values[:-1]
print len(values)

I had some extra prints in there for the 2020, but printing everything for 30 million just slows it down. The final length print is just to verify that it’s giving me the correct iteration value. The main this this could use for clean up is to replace the while loop “-7” subtraction with subtracting a variable equal to the length of the initial values set, so that you could potentially feed it a value set that is larger or smaller.

The trickiest part here was figuring out the positions of the last two occurrences of a number, which meant counting backwards through the array of values. For the second number, I ended up using a reverse copy of the array, because I kept getting screwball answers trying to do it directly like I had for the first number. I would have liked to make it work with the more elegant solution but I didn’t have time to keep working on it.

« Previous Page — Next Page »