RSS

This Week in Flynn

This week was all about usability and stability. Work focused on bugs reported and improvements requested by users.

By popular request the Flynn CLI is now available as a Windows binary. Go’s native Windows support made this change relatively quick and easy. All versions of the Flynn CLI are now static binaries.

Work also continued on updater support for the Postgres appliance which remains a work in progress.

§ Changes

§ Enhancements

  • Added support for Windows CLI binaries (#1350, #1353, #1356)
  • Bumped ioutil (#1355)
  • Added discoverd DNS support to test runner (#1363)
  • Improved demo environment with Makefile (#1304)
  • Refactored log aggregator filtering (#1352)
  • Made all binaries static (#1364)
  • Switched to Heroku-maintained Go buildpack (#1368)
  • Bumped Docker image handling packages (#1357)
  • Added initial support for deploying/updating Postgres (#1301)
  • Improved CLI controller client to use DialTLS (#1332)
  • Added support for changing the controller key (#1325)

§ Bugfixes

  • Fixed race in log aggregator (#1346)
  • Removed eu-central-1 from regions in installer (#1347)
  • Changed CLI to select next cluster when removing default (#1370)
  • Fixed installer when flynn-host is running (#1372)
  • Improved failure handling in installer (#1341)

§ Stay in Touch

§ How You Can Help

This Week in Flynn

Most of this week’s changes are minor bugfixes and refactoring.

Many new users launched Flynn clusters after the Gamma announcement and we have been working hard to fix the bugs they reported as quickly as possible while work progresses on other major components.

If you install or use Flynn, especially if you use the manual install script, please report any bugs or unexpected behavior so we can fix them.

§ Changes

§ Enhancements

  • Added start script for etcd (#1291)
  • Added start script for discoverd (#1292)
  • Updated installer to configure CLI (#1305)
  • Improved code based on output of linters (#1307)
  • Implemented log aggregator buffer snapshotting (#1293)
  • Updated Python, Java, Scala, and Multi buildpacks (#1316)
  • Updated Ubuntu to 14.04.2 (#1315, #1318)
  • Added robust SSH key reuse to AWS installer (#1326)

§ Bugfixes

  • Removed timestamps from dashboard buildpack output (#1288)
  • Fixed buildpacks with no default process types (#1289)
  • Fixed log handling blocking flynn-host shutdown (#1290)
  • Fixed configuring AWS installer credentials (#1295)
  • Fixed configuring AWS installer instance configuration (#1299)
  • Fixed broken links in README (#1302)
  • Added backoff to router sync errors (#1306)
  • Removed proxy use in slugrunner when communicating with blobstore (#1309)
  • Stopped release script from overwriting tags (#1319)
  • Added error handling if release tag fails (#1323)
  • Removed newline in gitreceive cache URL (#1310)
  • Ensured that sources.list.d exists when running install script (#1331)

§ Stay in Touch

§ How You Can Help

This Week in Flynn

Several major features shipped in the last week including log aggregation. Log aggregation includes filtering and tailing and is accessible through both web dashboard and CLI.

As part of our effort to make Flynn as easy to install as possible we replaced the command-line interface to the AWS installer with a web GUI. The new installer ships as part of the Flynn CLI which now updates securely using The Update Framework.

We also shipped a CLI utility for the Postgres appliance that allows users to dump and restore Postgres databases on an application-specific basis.

§ Changes

§ Enhancements

  • Implemented app log aggregation, filtering, and tailing (#1240, #1252, #1267)
  • Changed CLI updater to use The Update Framework (#1250, #1273)
  • Replaced command-line installer UI with web GUI (#1186, #1275, #1199)
  • Implemented CLI command to dump and restore Postgres databases (#1213)
  • Added option to generate tarball of debug logs to flynn-host collect-debug-info (#1221)
  • Changed dashboard server to include assets in binary (#1227)
  • Added support for explaining CI failures (#1228)
  • Implemented cross-compilation of CLI binary (#1226)
  • Added name tags to AWS resources (#1210)
  • Added host ID to FLYNN_JOB_ID env (#1233)
  • Improved logging and timeouts in tests (#1242)
  • Bumped etcd to v2.0.5 (#1254)
  • Added client connection logging to Postgres (#1265)
  • Added support for unit testing shell scripts (#1266, #1270)
  • Added iptables rules to debug info (#1281)
  • Moved release manifest types into separate package (#1282)
  • Added error when creating discovery token for single-node cluster (#1283)
  • Improved error message when router listen fails (#1284)
  • Added status endpoint to Postgres manager (#1201)
  • Added API endpoint to send signals to jobs (#1209)
  • Bumped osex and go-update packages (#1212)
  • Added flynn-host --version (#1219)
  • Added verbosity to flynn-host collect-debug-info (#1220)

§ Bugfixes

  • Fixed 500 on duplicate app creation (#1211, #1248)
  • Bumped max open files per job to 10,000 (#1229)
  • Ensured that ZFS kernel module gets built during install (#1241)
  • Set FLYNN_* environment variabls for one-off jobs (#1247)
  • Fixed tracking of CI VMs (#1249)
  • Ensured that CI kills containers after stopping flynn-host (#1256)
  • Fixed example image URI in CLI (#1259)
  • Fixed release version generator (#1271, #1278)
  • Updated outdated CLI command list (#1268)
  • Wrapped interactive job test in timeout (#1272)
  • Removed goroutine leak in test (#1274)
  • Fixed slugrunner one-off command quoting (#1277)
  • Stopped including env vars in debug info (#1280)
  • Removed deadlock in health register test (#1204)
  • Fixed error when dumping debug logs that don’t exist (#1218)

§ Stay in Touch

§ How You Can Help

This Week in Flynn

It’s been another busy week at Flynn. The response to the Gamma release has been exactly what we hoped — lots of new people installing and trying out Flynn. Our priority has been to address the bugs these users have identified in addition to helping other new users get started in the IRC channel.

We also implemented full-cluster restart handling so data persists across restarts.

Docs continue to evolve with new pages for both the architectural overview and Postgres appliance.

If you’d like help setting up Flynn, have encountered a possible bug, or are using Flynn in production, we’d love to hear from you on IRC, GitHub, or email.

§ Changes

§ Enhancements

  • Implemented full-cluster restart handling (#1187, #1190, #1191, #1194)
  • Added taffy deploy to update process (#1139)
  • Set wildcard certificate as router fallback (#1122)
  • Changed flynn psql to pass arbitrary arguments (#1155)
  • Added docs for Postgres (#1154)
  • Updated flynn psql to use less for paging (#1156)
  • Implemented flynn resource to list resources associated with an app (#1137)
  • Add support for custom subnets to flynn install (#1164)
  • Bumped buildpacks for new PHP versions, Rails 5 support, and Rails 4 asset fixes (#1135)
  • Added timestamps to CI cluster log messages (#1181)
  • Implemented state change logging in containerinit (#1180)
  • Rewrote the architecture page (#1198)

§ Bugfixes

  • Changed install script to fail if download fails (#1144)
  • Added CI unit test timeout (#1166)
  • Fixed flynn install usage documentation and parsing (#1153)
  • Fixed flynn install into non-default regions (#1173)
  • Implemented retries for failing controller connections (#1178)
  • Fixed initializing the TUF client after partial initialization (#1146)
  • Prevented CI from killing the cluster if the release test fails (#1184)
  • Fixed a postgres edge case that incorrectly marks replication as corrupt (#1188)
  • Fixed deployment edge cases (#1192)
  • Changed CI to wait for Docker before starting (#1193, #1197)
  • Removed SO_REUSEPORT usage in router test suite (#1195)
  • Fixed git pushes after deleting and recreating an app (#1171)

§ Stay in Touch

§ How You Can Help

This Week in Flynn

The past two weeks have been a major leap forward for Flynn. We shipped the Gamma release of Flynn last week. This release is a dramatic improvement on the beta and brings us much closer to production-ready status. A number of substantial enhancements coincided with the release.

The Flynn Postgres appliance has been rewritten from scratch bringing with it tremendous improvements in stability and performance. It will serve as a model for future Flynn database appliances.

The Flynn CLI now includes an installer that is capable of installing Flynn into the user’s AWS account.

Git repos are now cached so if a user pushes to Flynn multiple times, the entire repository will not need to be transferred each time.

A new version of the updater also landed. This version is capable of updating most of the layer 1 components including the controller and the router without downtime.

§ Changes

§ Enhancements

  • Added flynn psql command for easy access to the Postgres console (#1124)
  • Added support for persisting volume information across host restarts (#924)
  • Added flynn-host destroy-volumes command for destroying volumes (#973, #979, #1044, #1112)
  • Implemented support for taking volume snapshots and transmitting them to other hosts (#1018)
  • Implemented second phase of Flynn in-place updater (#1105)
  • Rewrote postgres appliance from scratch to be correct and fault tolerant (#1069, #1091)
  • Implemented persistent git repo caching (#1035)
  • Implemented a simple AWS Flynn installer (#1090, #1114, #1116, #1115)
  • Added AWS launch support to development Vagrantfile (#1022)
  • Changed multi-node clusters to run in a highly-available configuration (#1089)
  • Switched to synchronous synchronization of router datastores (#1002)
  • Removed unused action type from bootstrap (#1019)
  • Added support for waiting for service discovery events to deployer (#1007)
  • Bumped Go to 1.4.2 (#1023)
  • Changed all schedulers to watch job events (#1021)
  • Improved ephemeral CA certificate installation docs (#1031)
  • Bumped Node.js, Java, Scala, and PHP buildpacks (#1024)
  • Updated dashboard to use new router JSON structure (#1032)
  • Updated Releasing Flynn documentation for TUF distribution (#1041)
  • Rearranged development documentation (#1042)
  • Exposed logs from containerinit for debugging (#1043)
  • Improved deployer to support deploying the controller (#1027)
  • Added job state transition constraint to controller database (#1027)
  • Moved app protected flag to app metadata and removed restrictions (#1053)
  • Queued job cache updates so that they are delivered in order (#1056)
  • Stopped flynn-host upstart job from respawning on crash (#1062)
  • Clarified documentation about configuring firewalls (#1064)
  • Bumped etcd to v2.0.3 (#1054)
  • Implemented support for manual leader election in service discovery (#1059)
  • Removed website from repository, leaving docs (#1070)
  • Added documentation about installing on Linode (#1080)
  • Improved support for multiple clusters in CLI (#859)
  • Updated controller deploy test to run concurrently (#1066)
  • Allowed overriding install script binary checksum (#1099)
  • Exposed automatic metadata to service discovery client users (#1106)
  • Installed tuf-client in CI rootfs (#1103)
  • Added CI support for booting multiple clusters (#1118, #1121)
  • Added IRC notifications to CI (#1120)

§ Bugfixes

  • Fixed image URL in example generator (#1010)
  • Added missing fields to router schema and examples (#1011)
  • Fixed race when rolling back deploys (#1014)
  • Stopped pulling scratch container image in tests (#1028)
  • Fixed dashboard log output in Chrome/Safari (#1033)
  • Stopped daemons from starting during CI rootfs build (#1038)
  • Fixed deadlock when sending error to SSE stream (#1048)
  • Allowed creating apps from CLI when not in a git repo (#1081)
  • Secured CI cluster authentication (#1061)
  • Changed dashboard to use deployer for releases (#1082)
  • Fixed buildpack check ordering (#1029)
  • Fixed dashboard route handling (#1083)
  • Fixed intermittently broken deployer test (#1088)
  • Added missing JSON tags to service metadata (#1093)
  • Removed extraneous field from layer 0 manifest (#1117)

§ Stay in Touch

§ How You Can Help

 RSS



Mailing List