Golang News http://golangnews.com Jobs, Code, Videos and News for Go hackers - everything about the go programming language Sun, 02 Jul 2023 15:57:00 +0000 How to Use Iris and PostgreSQL for Web Development #web #database <h5>A guide to using PG middleware, a package for Iris that provides easy and type-safe access to PostgreSQL database.<br></h5> 1 points posted by iris-go https://dev.to/kataras/how-to-use-iris-and-postgresql-for-web-development-3kka 4810 Sun, 02 Jul 2023 15:57:00 +0000 Unpacking git packfiles with Go #git #data 19 points posted by lolly https://codewords.recurse.com/issues/three/unpacking-git-packfiles 322 Mon, 19 Oct 2015 23:48:00 +0000 Golang data science libraries #data The Golang programming language is on a par with Python when it comes to ease of use, but the code compiles to a binary that runs almost as fast as C. So Golang is worth considering for any task that crunches large volumes of data. This is a curated list of Golang libraries useful in data science and related fields. 13 points posted by andythomas http://www.mjhall.org/golang-data-science-libraries 1480 Fri, 06 Jan 2017 15:06:00 +0000 Code: 💧 In memory dataset filtering #web #data #filtering 13 points posted by Matt Evans https://github.com/mattevans/distil 1385 Mon, 19 Dec 2016 06:08:00 +0000 Kingshard – A high performance proxy for MySQL powered by Go #mysql #data Kingshard is a high-performance proxy for MySQL powered by Go. Just like other mysql proxies, you can use it to split the read/write sqls. Now it supports basic SQL statements (select, insert, update, replace, delete). The most important feature is the sharding function. Kingshard aims to simplify the sharding solution of MySQL. 13 points posted by flike https://github.com/flike/kingshard 306 Mon, 19 Oct 2015 03:19:00 +0000 Video: Go, C++, or Java for dna sequencing pipelines? #dotgo #data <p>While Go is not designed for parallel programming, it nevertheless has features that are beneficial for parallelism, especially a work-stealing scheduler for goroutines and a concurrent, parallel garbage collector.&nbsp;Pascal Costanza&nbsp;presents an evaluation of programming languages for expressing DNA sequencing pipelines, with Go along C++ and Java. Go hits a sweet spot of performing really well with little programming effort.</p> 12 points posted by kenny https://www.dotconferences.com/2017/11/pascal-costanza-go-c-plus-plus-java-for-dna-sequencing-pipelines 3016 Tue, 12 Dec 2017 12:06:00 +0000 graphql - An implementation of GraphQL for Go #data A <em style="box-sizing: border-box; color: rgb(36, 41, 46); font-family: -apple-system, system-ui, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px; background-color: rgb(255, 255, 255);">work-in-progress</em>&nbsp;implementation of GraphQL in Go. Its currently a port of <code style="box-sizing: border-box; font-family: SFMono-Regular, Consolas, &quot;Liberation Mono&quot;, Menlo, Courier, monospace; font-size: 13.6px; padding: 0.2em 0px; margin: 0px; background-color: rgba(27, 31, 35, 0.05); border-radius: 3px; color: rgb(36, 41, 46);">graphql-js</code> <a href="https://github.com/graphql/graphql-js/releases/tag/v0.6.0" style="box-sizing: border-box; background-color: rgb(255, 255, 255); color: rgb(3, 102, 214); font-family: -apple-system, system-ui, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px;">v0.6.0</a>&nbsp;which is based on the <a href="https://github.com/facebook/graphql/releases/tag/April2016" style="box-sizing: border-box; background-color: rgb(255, 255, 255); color: rgb(3, 102, 214); font-family: -apple-system, system-ui, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px;">April 2016</a>&nbsp;GraphQL specification. Future efforts will be guided directly by the <a href="https://github.com/facebook/graphql/releases" style="box-sizing: border-box; background-color: rgb(255, 255, 255); color: rgb(3, 102, 214); font-family: -apple-system, system-ui, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px;">latest formal GraphQL specification</a>(currently: <a href="https://github.com/facebook/graphql/releases/tag/October2016" style="box-sizing: border-box; background-color: rgb(255, 255, 255); color: rgb(3, 102, 214); font-family: -apple-system, system-ui, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px;">October 2016</a>). 12 points posted by Donutloop https://github.com/graphql-go/graphql 2898 Sun, 05 Nov 2017 17:05:00 +0000 Video: The hidden micro-service - caching with Go at Netflix #data #caching Netflix is well known for championing the microservice model, but within the complex layers of dependencies is a hidden service: the caching layer. The Netflix customer experience relies heavily on caches to provide a high-volume, low latency, globally available data layer that backs our stateless services. Throughout a typical customer experience, from sitting down on the couch through playing a movie, caches play a role in every interaction. The use cases here range from session storage to video history to subscriber status, all of which benefit from the stability and fault tolerance of EVCache, the primary caching system in use at Netflix. 12 points posted by kenny https://www.youtube.com/watch?v=Rzdxgx3RC0Q 1580 Fri, 20 Jan 2017 13:24:00 +0000 Show: Statistics Package #data Golang statistics package with common functions that are missing from the standard library. 12 points posted by anonfunction https://github.com/montanaflynn/stats 238 Tue, 13 Oct 2015 19:05:00 +0000 QL - a pure Go embedded SQL database #data #db 12 points posted by lolly https://github.com/cznic/ql 151 Tue, 06 Oct 2015 16:15:00 +0000 textql - execute SQL against structured text like CSV or TSV #sql #data Execute SQL against structured text like CSV or TSV by dinedal 11 points posted by kenny https://github.com/dinedal/textql 1530 Sat, 14 Jan 2017 07:08:00 +0000 Simple HTTP Spider and Scheduler for scraping and parsing HTML and JSON pages #data #web Spider package provides some simple spider and scheduler interfaces for scraping and parsing HTML and JSON pages. 11 points posted by celrenheit https://github.com/celrenheit/spider 197 Fri, 09 Oct 2015 14:56:00 +0000 Ribbon diagrams of proteins in Go #data #science #graphics Ribbon diagrams of proteins in #golang. WIP. by fogleman 10 points posted by kenny https://github.com/fogleman/ribbon 1950 Thu, 16 Mar 2017 22:39:00 +0000 Getting Started with Golang and Couchbase #nosql #couchbase #database 10 points posted by nraboy http://blog.couchbase.com/2016/november/getting-started-with-golang-and-couchbase 1188 Tue, 01 Nov 2016 16:00:00 +0000 Readeef - open source feed aggregator written in Go #web #data <a href="http://www.sugr.org/en/products/readeef ">Project website & screenshots</a> 10 points posted by gopher https://github.com/urandom/readeef 295 Sat, 17 Oct 2015 21:22:00 +0000 gleam - a map/reduce system in go #data Fast, efficient, and scalable distributed map/reduce system written in pure Go, runs standalone or distributedly. by chrislusf 9 points posted by gopher https://github.com/chrislusf/gleam 1608 Mon, 23 Jan 2017 20:26:00 +0000 Pila db - stack-based data storage #data 9 points posted by kenny https://github.com/fern4lvarez/piladb 1408 Thu, 22 Dec 2016 06:36:00 +0000 pgproxy - a postgreSQL proxy server #data #db PostgreSQL proxy server by wgliang 8 points posted by fiisio https://github.com/wgliang/pgproxy 1725 Mon, 13 Feb 2017 08:03:00 +0000 Gormigrate - Minimalistic database migration helper for Gorm #database #migration 8 points posted by andreynering https://github.com/go-gormigrate/gormigrate 1031 Wed, 31 Aug 2016 16:31:00 +0000 Cockroach DB: A Scalable, Geo-Replicated, Transactional Datastore #data 8 points posted by gopher https://github.com/cockroachdb/cockroach 260 Thu, 15 Oct 2015 12:34:00 +0000 Pgx - a faster PostgreSQL client library for Go #data #psql #db 8 points posted by kenny https://github.com/jackc/pgx 200 Fri, 09 Oct 2015 19:48:00 +0000 DBShield - a database firewall in Go #data #sql Database firewall written in Go by nim4 7 points posted by kenny https://github.com/nim4/DBShield 1743 Wed, 15 Feb 2017 07:12:00 +0000 Go hep - libraries and applications for High Energy Physicists data analysis #physics #data go-hep is a set of libraries and applications allowing High Energy Physicists to write efficient analysis code in the Go programming language. Go brings the fast edit-compile-run cycle that interpreted language users know and the runtime efficiency that compiled languages users expect. go-hep provides the needed HEP oriented packages on top of this concurrency-enabled language. 7 points posted by kenny http://go-hep.github.io 1689 Tue, 07 Feb 2017 22:00:00 +0000 fit - curve fitting in go #data Fit by go-hep is a WIP package to provide easy fitting models and curve fitting functions. 7 points posted by drogo https://github.com/go-hep/fit 1533 Sat, 14 Jan 2017 12:12:00 +0000 vellum - A Go library implementing an FST (finite state transducer) #data A Go library implementing an FST (finite state transducer) by couchbaselabs 6 points posted by drogo https://github.com/couchbaselabs/vellum 1943 Thu, 16 Mar 2017 07:11:00 +0000 Why go was the right choice for cockroachdb #data #db 6 points posted by drogo https://www.cockroachlabs.com/blog/why-go-was-the-right-choice-for-cockroachdb 1607 Mon, 23 Jan 2017 13:38:00 +0000 Go tsz - Time series compression algorithm from Facebook's Gorilla paper #data 6 points posted by andythomas https://github.com/dgryski/go-tsz 624 Tue, 23 Feb 2016 20:03:00 +0000 Go datastructures #data #golang 6 points posted by gopher https://github.com/Workiva/go-datastructures 325 Tue, 20 Oct 2015 07:45:00 +0000 Sharding PostgreSQL with Go #db #data #psql 6 points posted by lolly https://github.com/go-pg/sharding 193 Fri, 09 Oct 2015 07:11:00 +0000 Querying for a single record using Go's sql package #sql #data 5 points posted by gopher https://www.calhoun.io/querying-for-a-single-record-using-gos-database-sql-package 1938 Wed, 15 Mar 2017 20:24:00 +0000 Video: Binary encoding, Flatbuffers and gRPC #data #grpc Binary encoding, Flatbuffers and gRPC by Manish R Jain - Go Meetup, October 2016 5 points posted by gopher https://www.youtube.com/watch?v=aEqNSR1CgLk 1765 Sat, 18 Feb 2017 10:12:00 +0000 Cast: Go data science with daniel whitenack #data Data science is typically done by engineers writing code in Python, R, or another scripting language. Lots of engineers know these languages, and their ecosystems have great library support. But these languages have some issues around deployment, reproducibility, and other areas. The programming language Golang presents an appealing alternative for data scientists. 5 points posted by tollela https://softwareengineeringdaily.com/2017/02/09/go-data-science-with-daniel-whitenack 1714 Sat, 11 Feb 2017 06:38:00 +0000 Replacing redis with boltdb #data 5 points posted by kenny http://specto.io/blog/replacing-redis-with-boltdb 1566 Thu, 19 Jan 2017 06:43:00 +0000 MQ - a message queue broker which supports http2 #data #http2 #net It is used mainly for testing. Purely a toy project according to the author but interesting all the same. 5 points posted by kenny https://github.com/asim/mq 1380 Sun, 18 Dec 2016 15:16:00 +0000 Working with redis in go #data #redis 5 points posted by lolly http://www.alexedwards.net/blog/working-with-redis 693 Sun, 13 Mar 2016 19:46:00 +0000 How We Built Uber Engineering’s Highest Query per Second Service Using Go #geo #data In early 2015 we built a microservice that does one thing (and does it really well), geofence lookups. One year later, this service is Uber’s highest queries per second (QPS) service out of the hundreds we run in production. Here’s the story of why we built this service, and how the relatively recent Go programming language helped us build and scale it so fast. 5 points posted by lolly https://eng.uber.com/go-geofence 634 Fri, 26 Feb 2016 12:11:00 +0000 Coding our breast cancer classifier in Go #data #machinelearning First of all, the complete code for this tutorial is on github at this <a href="https://github.com/italojs/knn/tree/for-dummies" data-href="https://github.com/italojs/knn/tree/for-dummies" class="markup--anchor markup--p-anchor" rel="noopener" target="_blank">link</a>. To start the project we need data, let’s then download the <a href="https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+%28Diagnostic%29" data-href="https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+%28Diagnostic%29" class="markup--anchor markup--p-anchor" rel="noopener" target="_blank">Breast Cancer Wisconsin </a>dataset that we saw in the previous <a href="https://medium.com/brasil-ai/knn-k-nearest-neighbors-2-f2ab9e5662b" data-href="https://medium.com/brasil-ai/knn-k-nearest-neighbors-2-f2ab9e5662b" class="markup--anchor markup--p-anchor" target="_blank">article</a>. <br><br class="Apple-interchange-newline"> 4 points posted by kenny https://towardsdatascience.com/knn-3-coding-our-breast-cancer-classifier-503b804988f8 3656 Mon, 12 Nov 2018 16:25:00 +0000 polluter - The easiest solution to seed database with Go #seed #database #testing 4 points posted by romanyx https://github.com/romanyx/polluter 3385 Wed, 13 Jun 2018 10:27:00 +0000 reflow - distributed, incremental data processing in the cloud #data a language and runtime for distributed, incremental data processing in the cloud 4 points posted by saml https://github.com/grailbio/reflow 2846 Wed, 25 Oct 2017 21:05:00 +0000 Working effectively with database nulls #data <p>This post covers how to marshall null values from a database into a <a href="http://golang.org" target="_blank">Go</a> struct type and how to save nulls back to the database. I’ll cover the standard library’s <a href="http://golang.org/pkg/database/sql/#NullString" target="_blank">sql.NullString</a>, NullInt64, NullFloat64, etc types — which I’ll refer to as sql.NullXYZ when indicating the collection of types and not a specific Null type — important methods on those types, telltale errors, and some helpers for working with values coming from form posts.</p> 4 points posted by gopher https://marcesher.com/2014/10/13/go-working-effectively-with-database-nulls 2785 Wed, 11 Oct 2017 10:31:00 +0000 Gosto: A Google Cloud Datastore client in Go #GCP #GKE #data <p>Google Cloud Datastore Client Wrapper in Go, for automation of key attachment.</p> <p>For example, inside of GKE container, you can access to datastore API of you're authorized with Service Account.</p><div><br></div> <h2><a id="user-content-table-of-contents" class="anchor" href="https://github.com/timakin/gosto#table-of-contents" aria-hidden="true" style="box-sizing: border-box; color: rgb(3, 102, 214); float: left; padding-right: 4px; margin-left: -20px; line-height: 1;"><svg aria-hidden="true" class="octicon octicon-link" height="16" version="1.1" viewBox="0 0 16 16" width="16"><path fill-rule="evenodd" d="M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"></path></svg></a></h2> 4 points posted by timakin https://github.com/timakin/gosto 2678 Wed, 20 Sep 2017 14:50:00 +0000 jsonapi serializer and deserializer #data #json jsonapi.org style payload serializer and deserializer by google 4 points posted by gopher https://github.com/google/jsonapi 1626 Thu, 26 Jan 2017 12:22:00 +0000 Ketama - libketama-style consistent hashing in Go #data With consistent hashing, in the event of the removal of a cache node, all keys that were hashing to one node to (in theory) evenly distribute to the other cache nodes. 4 points posted by gopher https://github.com/mncaudill/ketama 1498 Mon, 09 Jan 2017 20:06:00 +0000 Infinite sets in go #data 4 points posted by Tim Donell https://blog.haardiek.org/infinite-sets-in-go.html 1486 Sun, 08 Jan 2017 09:16:00 +0000 Ledisdb - a high performance NoSQL powered by Go #data 4 points posted by kenny https://github.com/siddontang/ledisdb 1445 Mon, 02 Jan 2017 21:12:00 +0000 Simplejson - a Go package to interact with arbitrary JSON #json #data 4 points posted by gopher https://github.com/bitly/go-simplejson 312 Mon, 19 Oct 2015 13:12:00 +0000 Compress - Optimized compression packages #data #web 4 points posted by kenny https://github.com/klauspost/compress 303 Sun, 18 Oct 2015 17:09:00 +0000 Sift - A fast and powerful open source alternative to grep #data 4 points posted by lolly https://github.com/svent/sift 129 Mon, 05 Oct 2015 18:50:00 +0000 Olric: Distributed and in-memory KV store which can be used as library or standalone server. #dht #key-value #database #distributed * Designed to share some transient, approximate, fast-changing data between servers, * Time-To-Live(TTL) eviction policy, * Highly available, * Horizontally scalable, * Provides best-effort consistency guarantees without being a complete CP solution, * Distributes load fairly among cluster members with a consistent hash function, * Supports replication by default(with sync and async options), 3 points posted by mastabadtomm https://github.com/buraksezer/olric 3836 Tue, 12 Mar 2019 15:54:00 +0000 Parsing DrugBank XML (or any large XML file) in streaming mode in Go #datascience Blog post exploring how large, tricky XML files can be parsed very efficiently using Go's awesome struct unmarshalling feature, without the need to read everything into memory from the start. Includes a full reproducible code workflow code example implemented with the <a href="http://scipipe.org">SciPipe</a> workflow library. 3 points posted by saml http://bionics.it/posts/parsing-drugbank-xml-or-any-large-xml-file-in-streaming-mode-in-go 3237 Fri, 16 Mar 2018 20:57:00 +0000