#nosql
data with bas[s|e].
Then:
Applications (always) had the same "brain" for data persistence ... (SQL) tables.
Today:
Choose between domain appropriate options going beyond tables ... flat key-value, hierarchically structured document, highly interconnected graph or big column stores.
Then:
Several languages, tools, configurations all over the datacenter.
Today:
Full-stack JavaScript: From the server's V8 engine down to the client's browser. Event-based asynchronous and functional programming included. JavaScript, of all times.
Then:
Heavy-weight virtual machines with hundreds of GB storage and hours of guess work.
Today:
Light-weight containers with written manifest for easy reproduction. No more multiplication of OS and licenses. Orchestration out-of-the box. Build, ship, run.
Import CSV Data into Redis with a Single CLI Command
A few weeks back at talpasolutions I needed - only for performance testing purposes - to import a .tsv file (round about 600,000 lines with time-stamped sensor data in 15 columns) to see how Redis handles it (especially memory wise). As it turned out the import is feasible with a single, one-(long)-line cli command. >>
arne on nosql, redis, linux | 12 FEBRUARY 2019
Playing Around with Redis 5 - LOLWUT
This is a post you do not need to read. There is no why in it. Just art. With Redis 5, besides the new native data type streams, a new tradition was initiated: The (technologically) use-/reasonless LOLWUT command. >>
arne on redis, nosql | 31 OCTOBER 2018
Serving a vue-cli Production Build on a Sub-Path with Nginx
Following two previous blog posts on using vue-cli with Docker this post now covers on how to do a production build of a vue-cli based app and how to deliver it via an nginx web server, especially on a (non-root) sub-path. >>
arne on vuejs, nodejs, docker | 30 SEPTEMBER 2018
Getting Started with vue-cli on Docker
Now that vue-cli as "the standard tooling baseline for the Vue ecosystem" has recently been released as stable in v3.x. here is a linear walk-through on how to use it in dockerized environment: Although the documentation for vue-cli is excellent - as always in vuejs - this post walks you through the minimum steps. >>
arne on vuejs, nodejs, docker | 31 AUGUST 2018
[P‑G‑A]
Postcode-Geopos-API:
NodeJS API based on Swagger/openAPI for retrieving geolocations from German postcodes (PLZ) stored in Redis
Use Case
The Postcode-Geopos-API easily makes it possible to query based on German postcodes (PLZ) for:
- their geoposition with longitude and latitude
- their OSM-Info-Object with further data
- all city names within the same PLZ lead region (e.g. 45)
- the distance between two postcode regions
Example
Geoposition 45130:["7.00937658548355103", "51.43758188556734012"]
OSM-Info-Object 45130:
{"osm_id":"2073330", "type":"postcode", "lon":"7.00937729260588", "boundingbox": ...}City Names 45:
["45127 Essen Stadtkern", "45128 Essen Südviertel", "45130 Essen Rüttenscheid", ...]
Distance 45130 40479 (km):
["27.6738","km"]
Test It
Amount Data
Geopositions: > 8,000
OSM-Info-Objects: > 8,000
City Names: > 12,500
Updated: 2017 - Q4
Implementation
Stack: Redis as database with a NodeJS API based on ExpressJS and Swagger-Node as well as Docker for deployment.
Status: Private Beta.
Access & Licenses:
- Data:
- License: ODbL - Copyright © OpenStreetMap contributors
- Data Files: https://github.com/daten-und-bass/postcode-geopos-api/tree/master/public/data
- API Source Code:
- License: MIT - Copyright © daten&bass
- Source Code: https://github.com/daten-und-bass/postcode-geopos-api
- API Access:
- Hosted by d&b: Token-based
- Self-hosted/on-premise: Free (e.g. with Docker image)
Usage
One of our blog posts explains the underlying data structures used in Redis and an example for a client implementation can be found here. If you would like to join us for private beta testing please send us a token request.
API Docs
cypherMe
Cypher your passwords ... and get two-factor paper passwords
Idea
The idea goes back to this blog post by John Graham-Cumming: http://blog.jgc.org/2016/05/two-factor-paper-passwords.html
About
Two-factor paper passwords are save to write down. They might be considered as a means for an off-line, non-digital password manager.
cypherMe helps (de)cyphering without storing.
Implementation
Open source: Source code and license
Stack: Server-side NodeJS for serving HTML, stateless client-side Javascript for cyphers, and Docker for deployment.
Available cyphers: Caesar, Reverse Word, Reverse Word and Case, Vigenère.
Password transformations: Completely client-side (via Javascript in browser).
Example
Password to encrypt: !2MySitePw§9
Cypher: Reverse word and case
Repetitions: 2
The (encrypted) password: 9§WpETIsYm2!9§WpETIsYm2!
fliXnet
our containerized node.js sample implementation of neo4j's graph movie database via openAPI (swagger)
Sample Implementation - The Famous Neo4j Movie Database
Modelling, storing, and retrieving data as a graph.
An HTML Web App and a JSON only API - Both Based on NodeJS Express
Full-Stack JavaScript.
Automatic API Validation and Documentation - via OpenAPI (Swagger)
REST. SOA. Microservices. Or whatever you might call it.
User Authentication - Backed by Redis as a data structure store for key-value pairs and hash maps
For sessions, login credentials and user accounts.
Based on the npm module Passport and custom Swagger Security Handlers.
Besides D3JS - Plain JavaScript without Framework Dependencies
HTML templating server-side via Jade.
XHR for client-side calls to the JSON API.
Using Material Design Lite Layouts and Components
Optimized for cross-device Use.
Easy, Reproducible Deployment - Based on Docker
Containerized Infrastructure.