Incidents reported on status page for Ash_Dev_Tools https://status.ashdevtools.org/ en https://status.ashdevtools.org/incident/935966 Fri, 26 Jun 2026 10:33:53 -0000 https://status.ashdevtools.org/incident/935966#5fff90127e3304343f7aeb029ab5a9098b8f937c34f026df1de76c0e66a266b9 Ubuntu-Server recovered. https://status.ashdevtools.org/incident/935966 Fri, 26 Jun 2026 09:54:25 -0000 https://status.ashdevtools.org/incident/935966#62e93eb192e3fca98415bb12acb9d855055d8d95620d28a233280bfea963bdc6 Ubuntu-Server went down. https://status.ashdevtools.org/incident/935966 Fri, 26 Jun 2026 09:52:10 -0000 https://status.ashdevtools.org/incident/935966#93e2f700112e2bcdebe6266b9ccb5d559a9e571ea566da132d402f4470c462ff ashdevtools.org went down. https://status.ashdevtools.org/incident/871126 Tue, 14 Apr 2026 10:00:14 -0000 https://status.ashdevtools.org/incident/871126#3e8c586236532a7de6e494bbf907e32caa37c8dc4c2a1cfa6c4009162ad39f58 Systems down for maintenance. https://status.ashdevtools.org/incident/864569 Sat, 04 Apr 2026 10:00:16 -0000 https://status.ashdevtools.org/incident/864569#6db4f6914eec83d124b41df16a450dee8ed3ebf6e084797021060fc9d899f899 All Done! https://status.ashdevtools.org/incident/851270 Tue, 17 Mar 2026 12:25:00 -0000 https://status.ashdevtools.org/incident/851270#0e98ed6b8c6e7ab8a8994447d7be6bada23352a3fc0f75c337ea0d686a9d69d1 Cisco getting a Tesla p4 https://status.ashdevtools.org/incident/845294 Wed, 11 Mar 2026 18:47:00 -0000 https://status.ashdevtools.org/incident/845294#dbd851ca8df25f7d91edc300a5c9e5d48465eef74bd7b9728aabf3831fa7ef1b Issues fixed. Everything coming back online. 822 is fine, m2_1 dead. /mnt (fast) resilvered, now scrubbing and smartctl -t long on both https://status.ashdevtools.org/incident/845294 Tue, 10 Mar 2026 18:13:00 -0000 https://status.ashdevtools.org/incident/845294#9d9fe99fe11c647fb718d979cf08c8235cb20cf0ed82ba98e47a715df6903203 Prod still down, replacement drive being tested during the night and should be up and running by 8PM 11 March 2026 https://status.ashdevtools.org/incident/845294 Mon, 09 Mar 2026 17:18:00 -0000 https://status.ashdevtools.org/incident/845294#f43f388ea70918fab501172a94d02d6d39da23ae55e079e580364e014e142f77 We are having some issues with drives being unstable, for now all services are down for the next 48 hours. /mnt 822 failed, so fast is degraded, backups are being made, replacement coming soon. https://status.ashdevtools.org/incident/845294 Mon, 09 Mar 2026 14:34:06 -0000 https://status.ashdevtools.org/incident/845294#67fe3df446b84d3ed2a95b8df7bdc61e79c8809dfc8693ee9d0422160ca94322 Cisco Server went down. https://status.ashdevtools.org/incident/845294 Mon, 09 Mar 2026 14:33:31 -0000 https://status.ashdevtools.org/incident/845294#78ea15013b1cf26d087d199ea2232562a56753edc5c82e6306085a509d642f09 Ubuntu-Server-Nas went down. https://status.ashdevtools.org/incident/845294 Mon, 09 Mar 2026 14:30:57 -0000 https://status.ashdevtools.org/incident/845294#4b83036314476baa717e19e96763d099bebf0adc5ed48bb580ff9bfac384026f ashdevtools.org went down. https://status.ashdevtools.org/incident/842173 Fri, 06 Mar 2026 07:00:00 -0000 https://status.ashdevtools.org/incident/842173#5442699474f271b3b1f00fea11da24d33e1bbcf00a2e0715d8b59140ad278233 A massive rewiring of the ethernet. https://status.ashdevtools.org/incident/830055 Sat, 21 Feb 2026 10:00:00 -0000 https://status.ashdevtools.org/incident/830055#2634d39a8d1b02755e0e3da943afb2003bac9f60960f287ba8496055bd48b2dd /mounted will be modified, aswell as /mnt-temp https://status.ashdevtools.org/incident/822903 Wed, 11 Feb 2026 06:26:00 -0000 https://status.ashdevtools.org/incident/822903#62e83762def13b76384f324ce7de7f44f2a8689346f4b1d416e689ed87f38b21 Incident Date: 2026-02-11 Timezone: CET Duration: ~14–15 minutes Impact Window: 02:35:56 – 02:50:08 Between 02:35 and 02:50 CET, all externally exposed services became unreachable. The Ubuntu server itself remained operational, but both inbound and outbound internet connectivity were lost. Root cause was a temporary upstream ISP (Ziggo) network interruption. 02:35:56 Navidrome died (502) 02:36 Better stack initiated an Incident based on ashdevtools.org being 502 across the 3 regions. ---All other services died inbetween 02:38:42 Vaultwarden died (530) 02:39 Better stack changed the Incident based on ashdevtools.org to a 530 across the 3 regions. 02:44 Better stack initiated an Incident based on Ubuntu-Server not heartbeating for 5 min. ------- 02:47 Better stack closed incident based on Ubuntu-Server because of automatic resolvement. 02:50:08 Gitea online (200) ---All other services come back up 02:51:01 Minio Web online (200) 02:51 Monitors based on ashdevtools.org recovered across the 3 regions. 02:52 Better stack closed Incident based on ashdevtools.org because of automatic resolvement. https://status.ashdevtools.org/incident/822903 Wed, 11 Feb 2026 01:52:57 -0000 https://status.ashdevtools.org/incident/822903#69a5603f2a300b9e91357fd08af296c3bfc37d71d4e7cb741da8113a6c214ac4 ashdevtools.org recovered. https://status.ashdevtools.org/incident/822903 Wed, 11 Feb 2026 01:47:41 -0000 https://status.ashdevtools.org/incident/822903#bf42009933cfa8f3b8edb96f9610dbd0922a02cb994386deb664e4498aa099d9 Ubuntu-Server-Nas recovered. https://status.ashdevtools.org/incident/822903 Wed, 11 Feb 2026 01:44:14 -0000 https://status.ashdevtools.org/incident/822903#1eb9dd32eb5e41814e90cfbbbbcb165a2022dc9f9478e0345dc8f65fe2fbd42e Ubuntu-Server-Nas went down. https://status.ashdevtools.org/incident/822903 Wed, 11 Feb 2026 01:36:58 -0000 https://status.ashdevtools.org/incident/822903#de9fbb49cd5d0405156d2f9b2c05ce9cabd4c39994e210789baf26f2da5721ec ashdevtools.org went down. https://status.ashdevtools.org/incident/821215 Sun, 08 Feb 2026 18:30:47 -0000 https://status.ashdevtools.org/incident/821215#1b06dd32d6ac89bf2925684f78a5c22d36b3257cfc20e2371a6b5c2502edac6f Changing filesystems https://status.ashdevtools.org/incident/819812 Fri, 06 Feb 2026 10:00:59 -0000 https://status.ashdevtools.org/incident/819812#02b41e670f35398d98e2d8b0876b5314de119adcec9933f35fc7f822d3138674 Adding a server rack and redoing wiring. https://status.ashdevtools.org/incident/817536 Tue, 03 Feb 2026 11:00:00 -0000 https://status.ashdevtools.org/incident/817536#c1ad4ad94016f7e25d700f1e838006015e4bdba89f1631563e227963035c82ba Even more storage and cooling, length will be depended on Delivery services. https://status.ashdevtools.org/incident/816937 Mon, 02 Feb 2026 15:30:53 -0000 https://status.ashdevtools.org/incident/816937#7a9236c1742cdb8f5ae85e44ddae74772cd3e6dd8c45471dc0ba3d3710cb4d27 Adding more storage :) https://status.ashdevtools.org/incident/806283 Sat, 17 Jan 2026 13:23:09 -0000 https://status.ashdevtools.org/incident/806283#606effdaddf6e0ecd98bd2b1c7885fc2ad5aa9a1ba0e19e9d8e0226659159b36 For testing and upgrading of the server to newer systems and drives the full stack of services will be down for the next 6 hours. They might appear online but that is likely temporary and unstable. Best to not access anything regarding our services. https://status.ashdevtools.org/incident/796091 Wed, 31 Dec 2025 22:26:24 -0000 https://status.ashdevtools.org/incident/796091#6327559a0775f7287942bb57596189f02172e60bb296000a0e8e7f32df8f2cd8 Maintenance completed https://status.ashdevtools.org/incident/796091 Wed, 31 Dec 2025 21:00:42 -0000 https://status.ashdevtools.org/incident/796091#99d95b20b298c3f5c2c3218d2bec0c299729eb7aa1a230d0bf8cf3f0320353b3 All services will be unavailable for about ~2 hours due to the server going down for maintenance e.g. updates, cleaning and rewiring. https://status.ashdevtools.org/incident/771441 Fri, 21 Nov 2025 11:21:03 -0000 https://status.ashdevtools.org/incident/771441#3118afeffe095dbb2abb868dd9e326aa68f1573ad359c4d04e7ceefb7b2eb84f Ubuntu-Server-Nas recovered. https://status.ashdevtools.org/incident/771441 Fri, 21 Nov 2025 07:36:16 -0000 https://status.ashdevtools.org/incident/771441#16d6f42c2ceee228e8f4c0f2a13656b6f5ac465d36837f8f07f5fb1d1ce3aee1 Ubuntu-Server-Nas went down. https://status.ashdevtools.org/incident/756683 Tue, 04 Nov 2025 13:00:11 -0000 https://status.ashdevtools.org/incident/756683#43c1f14571d03a096ef3e67b11f212109cc69af8a9055a64779b63c2c0bc10bd Adding 2 iron wolfs and making a raid 6 out of the 4 ironwolfs. NS will be thrown over to the PI for at least an hour or 2. https://status.ashdevtools.org/incident/741724 Sat, 11 Oct 2025 14:00:52 -0000 https://status.ashdevtools.org/incident/741724#79075c4a863f112f9c043e1e1e05748d051d36cf0ce6143a2e1670ef2e26f514 Server can go down anytime, it depends on DHL, should only be about ~5 min when it actually goes down before it goes up again. https://status.ashdevtools.org/incident/735518 Wed, 01 Oct 2025 23:30:00 -0000 https://status.ashdevtools.org/incident/735518#c93f733fa10bb90331d1ec8f98eb8c61695d024ef4fb6422e36c9ce326d51a13 Everything recovered. https://status.ashdevtools.org/incident/735518 Wed, 01 Oct 2025 23:21:00 -0000 https://status.ashdevtools.org/incident/735518#0a83e45ccb5baf4b2f5ae392c83c8906fe58f5ade93145a8064cc0de56736b46 Everything went down. POWER OUTAGE https://status.ashdevtools.org/incident/733444 Sat, 27 Sep 2025 09:30:29 -0000 https://status.ashdevtools.org/incident/733444#8a90cadb78cf0e0dd1524c8a98afe69fc2754b43ab6800db50d65a6af029d12c Nothing changed FUCK DHL #extra drive, plus removal of the shit hdd https://status.ashdevtools.org/incident/733448 Sun, 31 Aug 2025 05:00:00 -0000 https://status.ashdevtools.org/incident/733448#0626917f85551c53cc410b5f50839bda0d67567b8216f5fe5341d333a5886713 FUCKING ZIGGO