Incidents reported on status page for Windmill https://windmill.betteruptime.com/ en https://windmill.betteruptime.com/incident/714264 Sun, 31 Aug 2025 17:30:00 -0000 https://windmill.betteruptime.com/incident/714264#a323cb9fbedfc7733bc431188d7879178d8d7870cabf9a381a989fb1d7b66e7c We have identified the root cause of the issue and resolved the situation. https://windmill.betteruptime.com/incident/714264 Sun, 31 Aug 2025 17:30:00 -0000 https://windmill.betteruptime.com/incident/714264#a323cb9fbedfc7733bc431188d7879178d8d7870cabf9a381a989fb1d7b66e7c We have identified the root cause of the issue and resolved the situation. https://windmill.betteruptime.com/ Sun, 31 Aug 2025 16:30:38 +0000 https://windmill.betteruptime.com/#a71f0b63c03fcc2e592c014c706fd8b22785fb2de3bbea5b9f2cbf7f0f9cc19e Integration Syncing recovered https://windmill.betteruptime.com/ Sun, 31 Aug 2025 07:40:44 +0000 https://windmill.betteruptime.com/#a71f0b63c03fcc2e592c014c706fd8b22785fb2de3bbea5b9f2cbf7f0f9cc19e Integration Syncing went down https://windmill.betteruptime.com/ Sun, 31 Aug 2025 04:30:14 +0000 https://windmill.betteruptime.com/#8cc32cf8af0559bba3592a29e649080c0c35892bee26903832c3fff3d0f60a0e Integration Syncing recovered https://windmill.betteruptime.com/ Sun, 31 Aug 2025 03:56:27 +0000 https://windmill.betteruptime.com/#dad7b28d3a8515e675feb0a9cbb790de1cbf61462dc9c25f884c1199d4eec58a Windy recovered https://windmill.betteruptime.com/ Sun, 31 Aug 2025 03:54:16 +0000 https://windmill.betteruptime.com/#a70768ffbcdcfeab341b8afadac5bc0949a1d0dddc771fdb51b19fcdd50b7adc Wep App recovered https://windmill.betteruptime.com/ Sun, 31 Aug 2025 03:40:48 +0000 https://windmill.betteruptime.com/#8cc32cf8af0559bba3592a29e649080c0c35892bee26903832c3fff3d0f60a0e Integration Syncing went down https://windmill.betteruptime.com/ Sun, 31 Aug 2025 03:26:29 +0000 https://windmill.betteruptime.com/#dad7b28d3a8515e675feb0a9cbb790de1cbf61462dc9c25f884c1199d4eec58a Windy went down https://windmill.betteruptime.com/ Sun, 31 Aug 2025 03:03:16 +0000 https://windmill.betteruptime.com/#a70768ffbcdcfeab341b8afadac5bc0949a1d0dddc771fdb51b19fcdd50b7adc Wep App went down https://windmill.betteruptime.com/ Sat, 30 Aug 2025 22:35:26 +0000 https://windmill.betteruptime.com/#89904caf84aadf826be0a9d96348fff0e96efa3b57d1690a219b35cfed534e90 Integration Syncing recovered https://windmill.betteruptime.com/ Sat, 30 Aug 2025 13:41:06 +0000 https://windmill.betteruptime.com/#89904caf84aadf826be0a9d96348fff0e96efa3b57d1690a219b35cfed534e90 Integration Syncing went down https://windmill.betteruptime.com/incident/714264 Sat, 30 Aug 2025 12:24:00 -0000 https://windmill.betteruptime.com/incident/714264#647edfde1b8f122a784fb3100fab4ad346651ffd2d50f5649a834f97aa8d1ddd We are experiencing similar issues again. This is surfacing as delays from Windy, duplicate execution and responses, report generation, and delayed data syncs. We apologize for any inconvenience and are working with them on a solution. https://windmill.betteruptime.com/incident/714264 Sat, 30 Aug 2025 12:24:00 -0000 https://windmill.betteruptime.com/incident/714264#647edfde1b8f122a784fb3100fab4ad346651ffd2d50f5649a834f97aa8d1ddd We are experiencing similar issues again. This is surfacing as delays from Windy, duplicate execution and responses, report generation, and delayed data syncs. We apologize for any inconvenience and are working with them on a solution. https://windmill.betteruptime.com/ Fri, 29 Aug 2025 14:59:08 +0000 https://windmill.betteruptime.com/#34ceb9916e3f8d2a8176de99e8740c6aee5cb84284083f49ebe1db01e1b64337 Integration Syncing recovered https://windmill.betteruptime.com/ Fri, 29 Aug 2025 07:41:19 +0000 https://windmill.betteruptime.com/#34ceb9916e3f8d2a8176de99e8740c6aee5cb84284083f49ebe1db01e1b64337 Integration Syncing went down https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 22:55:00 -0000 https://windmill.betteruptime.com/incident/714264#40a428a98710ab863291209c1ae5e46199aa4f41e52a90170087581674647d28 We believe that the situation has been resolved, but are continuing to monitor for any regressions. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 22:55:00 -0000 https://windmill.betteruptime.com/incident/714264#40a428a98710ab863291209c1ae5e46199aa4f41e52a90170087581674647d28 We believe that the situation has been resolved, but are continuing to monitor for any regressions. https://windmill.betteruptime.com/ Thu, 28 Aug 2025 21:30:45 +0000 https://windmill.betteruptime.com/#645ba8faa2c28b81b3fb70c9505ff503966087ed5ce784fa9a3780563c1a1744 Integration Syncing recovered https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 21:07:00 -0000 https://windmill.betteruptime.com/incident/714264#9ad68a15392f6c1325091e74dbe9717eedb2425542eb0983bd18eb5a87d405fe We are continuing to investigate the situation https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 21:07:00 -0000 https://windmill.betteruptime.com/incident/714264#9ad68a15392f6c1325091e74dbe9717eedb2425542eb0983bd18eb5a87d405fe We are continuing to investigate the situation https://windmill.betteruptime.com/ Thu, 28 Aug 2025 20:57:08 +0000 https://windmill.betteruptime.com/#645ba8faa2c28b81b3fb70c9505ff503966087ed5ce784fa9a3780563c1a1744 Integration Syncing went down https://windmill.betteruptime.com/ Thu, 28 Aug 2025 19:46:24 +0000 https://windmill.betteruptime.com/#17f76c5614ef11883a5635f570b74907be79df6aff544d3dcaeda79d75672a63 Integration Syncing recovered https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 19:08:00 -0000 https://windmill.betteruptime.com/incident/714264#09e6dff565f9e263cc5f3318219278ceeb5413df567080d45bc444166d75d245 We believe the root cause of the issue has been identified and are releasing a patch to target the issue. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 19:08:00 -0000 https://windmill.betteruptime.com/incident/714264#09e6dff565f9e263cc5f3318219278ceeb5413df567080d45bc444166d75d245 We believe the root cause of the issue has been identified and are releasing a patch to target the issue. https://windmill.betteruptime.com/ Thu, 28 Aug 2025 17:46:15 +0000 https://windmill.betteruptime.com/#17f76c5614ef11883a5635f570b74907be79df6aff544d3dcaeda79d75672a63 Integration Syncing went down https://windmill.betteruptime.com/ Thu, 28 Aug 2025 16:33:33 +0000 https://windmill.betteruptime.com/#4b040c83285d4513f27bab619b46ef4b3eb333a416b578f9feb3c13157c47b09 Integration Syncing recovered https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 16:30:00 -0000 https://windmill.betteruptime.com/incident/714264#ae9a7cf3b7fa2921d0946fc43c0f3f21908ca78d72ce280cd9f4cab5780fbd1f We are working with our providers on a resolution to the situation. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 16:30:00 -0000 https://windmill.betteruptime.com/incident/714264#ae9a7cf3b7fa2921d0946fc43c0f3f21908ca78d72ce280cd9f4cab5780fbd1f We are working with our providers on a resolution to the situation. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 15:30:00 -0000 https://windmill.betteruptime.com/incident/714264#f749fbd85bf61f5dd3f9408bcf4090f84de8f4d3a587a11acc0798fe92cd0c52 We are still investigating the root cause of the outage and hope to have more information soon. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 15:30:00 -0000 https://windmill.betteruptime.com/incident/714264#f749fbd85bf61f5dd3f9408bcf4090f84de8f4d3a587a11acc0798fe92cd0c52 We are still investigating the root cause of the outage and hope to have more information soon. https://windmill.betteruptime.com/ Thu, 28 Aug 2025 14:41:20 +0000 https://windmill.betteruptime.com/#4b040c83285d4513f27bab619b46ef4b3eb333a416b578f9feb3c13157c47b09 Integration Syncing went down https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 13:29:00 -0000 https://windmill.betteruptime.com/incident/714264#562a5a94bf383fd41dee779fe122f30be0742af76cc9d64a3360c5d602b280b6 We are experiencing issues with our message broken and distributed event execution. This is surfacing as delays from Windy, duplicate execution and responses, report generation, and delayed data syncs. We apologize for any inconvenience and are working with them on a solution. https://windmill.betteruptime.com/incident/714264 Thu, 28 Aug 2025 13:29:00 -0000 https://windmill.betteruptime.com/incident/714264#562a5a94bf383fd41dee779fe122f30be0742af76cc9d64a3360c5d602b280b6 We are experiencing issues with our message broken and distributed event execution. This is surfacing as delays from Windy, duplicate execution and responses, report generation, and delayed data syncs. We apologize for any inconvenience and are working with them on a solution. https://windmill.betteruptime.com/ Thu, 28 Aug 2025 04:30:20 +0000 https://windmill.betteruptime.com/#7fa1b53e7a03810b62878ddcbb74dcb766b2d345c1d0c8982ac184b68bc98e4e Integration Syncing recovered https://windmill.betteruptime.com/ Thu, 28 Aug 2025 02:41:03 +0000 https://windmill.betteruptime.com/#7fa1b53e7a03810b62878ddcbb74dcb766b2d345c1d0c8982ac184b68bc98e4e Integration Syncing went down https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 21:28:00 -0000 https://windmill.betteruptime.com/incident/710036#f4592a03e687b3f21fc33af6ab34ca8ac71aa3cb7319d63141fef0091cdecfbe The issue was related to cloudflare and has resolved itself https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 21:28:00 -0000 https://windmill.betteruptime.com/incident/710036#f4592a03e687b3f21fc33af6ab34ca8ac71aa3cb7319d63141fef0091cdecfbe The issue was related to cloudflare and has resolved itself https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 19:12:00 -0000 https://windmill.betteruptime.com/incident/710036#308484ebf97f3452a570757ad3cea94d35b57d4f8e167b04f874b1f186a185bc Cloudflare is reporting outages, services served with cloudflare are the primary ones affected. This includes: HRIS (merge.dev) HubSpot Linear Zoom AI Inference Providers https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 19:12:00 -0000 https://windmill.betteruptime.com/incident/710036#308484ebf97f3452a570757ad3cea94d35b57d4f8e167b04f874b1f186a185bc Cloudflare is reporting outages, services served with cloudflare are the primary ones affected. This includes: HRIS (merge.dev) HubSpot Linear Zoom AI Inference Providers https://windmill.betteruptime.com/ Thu, 21 Aug 2025 18:30:59 +0000 https://windmill.betteruptime.com/#7c4ebfdb919fbe863e2eaf36fbd2e1480eb494f595cc1416bfcc32ace9201d1f Integration Syncing recovered https://windmill.betteruptime.com/ Thu, 21 Aug 2025 17:42:27 +0000 https://windmill.betteruptime.com/#7c4ebfdb919fbe863e2eaf36fbd2e1480eb494f595cc1416bfcc32ace9201d1f Integration Syncing went down https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 17:13:00 -0000 https://windmill.betteruptime.com/incident/710036#a44eb97167fb3f810e328f48d0f30fbeec9f2ca8b50b0c9320dc1099210f2e68 Our infrastructure is experiencing an incident connecting to services outside of the cluster. We are working on resolving the issue. https://windmill.betteruptime.com/incident/710036 Thu, 21 Aug 2025 17:13:00 -0000 https://windmill.betteruptime.com/incident/710036#a44eb97167fb3f810e328f48d0f30fbeec9f2ca8b50b0c9320dc1099210f2e68 Our infrastructure is experiencing an incident connecting to services outside of the cluster. We are working on resolving the issue. https://windmill.betteruptime.com/ Tue, 19 Aug 2025 05:30:22 +0000 https://windmill.betteruptime.com/#4ad44a0e9f9613f8ac74b3bdecf8891c88a13c88429ade7dbbd678bba6542035 Integration Syncing recovered https://windmill.betteruptime.com/ Tue, 19 Aug 2025 04:41:02 +0000 https://windmill.betteruptime.com/#4ad44a0e9f9613f8ac74b3bdecf8891c88a13c88429ade7dbbd678bba6542035 Integration Syncing went down https://windmill.betteruptime.com/ Thu, 17 Jul 2025 14:30:21 +0000 https://windmill.betteruptime.com/#b2af8219c55ba24c6f2c829914e843e268801c4cd8f01cef1455ad92f0804550 Integration Syncing recovered https://windmill.betteruptime.com/ Thu, 17 Jul 2025 13:40:55 +0000 https://windmill.betteruptime.com/#b2af8219c55ba24c6f2c829914e843e268801c4cd8f01cef1455ad92f0804550 Integration Syncing went down https://windmill.betteruptime.com/ Sun, 29 Jun 2025 13:30:09 +0000 https://windmill.betteruptime.com/#56eafd2dd1aadce57d2520c1ba510442274d3736e1863084249e12f694a680b1 Integration Syncing recovered https://windmill.betteruptime.com/ Sun, 29 Jun 2025 12:40:52 +0000 https://windmill.betteruptime.com/#56eafd2dd1aadce57d2520c1ba510442274d3736e1863084249e12f694a680b1 Integration Syncing went down https://windmill.betteruptime.com/ Thu, 26 Jun 2025 15:30:09 +0000 https://windmill.betteruptime.com/#110d66e645e68b435f4721f82015edcf0d927bce692d6aff0470546a6043ed3d Integration Syncing recovered https://windmill.betteruptime.com/ Thu, 26 Jun 2025 10:40:43 +0000 https://windmill.betteruptime.com/#110d66e645e68b435f4721f82015edcf0d927bce692d6aff0470546a6043ed3d Integration Syncing went down https://windmill.betteruptime.com/incident/602553 Fri, 13 Jun 2025 13:40:00 -0000 https://windmill.betteruptime.com/incident/602553#8f5b96c03095d84347c9c313f64a86357529e4ecbdbb0d6026116d4ba245c77c We have identified the root cause and resolved the issues https://windmill.betteruptime.com/incident/602553 Fri, 13 Jun 2025 13:40:00 -0000 https://windmill.betteruptime.com/incident/602553#8f5b96c03095d84347c9c313f64a86357529e4ecbdbb0d6026116d4ba245c77c We have identified the root cause and resolved the issues https://windmill.betteruptime.com/incident/602553 Fri, 13 Jun 2025 10:30:00 -0000 https://windmill.betteruptime.com/incident/602553#8234b984706025df45887ef3bd2b54f1dbfe7f83f1ef359b4ebb7b4932ef0b87 A database cluster and instance size upgrade last night did not go as planned, and we introduced added latency and load into the system. https://windmill.betteruptime.com/incident/602553 Fri, 13 Jun 2025 10:30:00 -0000 https://windmill.betteruptime.com/incident/602553#8234b984706025df45887ef3bd2b54f1dbfe7f83f1ef359b4ebb7b4932ef0b87 A database cluster and instance size upgrade last night did not go as planned, and we introduced added latency and load into the system. https://windmill.betteruptime.com/ Fri, 13 Jun 2025 06:30:28 +0000 https://windmill.betteruptime.com/#bd946855153099950c8a6dbe65e92d19e03128bf38661c6a4fe41cdf6f259e96 Integration Syncing recovered https://windmill.betteruptime.com/incident/602274 Fri, 13 Jun 2025 05:15:12 -0000 https://windmill.betteruptime.com/incident/602274#92b3756678e669b37380c6a21c89645c90a06f1ecdc28fdda693c00e9846528b Maintenance completed https://windmill.betteruptime.com/incident/602274 Fri, 13 Jun 2025 05:15:12 -0000 https://windmill.betteruptime.com/incident/602274#92b3756678e669b37380c6a21c89645c90a06f1ecdc28fdda693c00e9846528b Maintenance completed https://windmill.betteruptime.com/ Fri, 13 Jun 2025 04:40:49 +0000 https://windmill.betteruptime.com/#bd946855153099950c8a6dbe65e92d19e03128bf38661c6a4fe41cdf6f259e96 Integration Syncing went down https://windmill.betteruptime.com/incident/602274 Fri, 13 Jun 2025 03:30:12 -0000 https://windmill.betteruptime.com/incident/602274#2c37d66beb93394eb3f22be9d6039b1fcc3592cf87c45b0e4e83e4d358ad6fc5 We will be performing a database upgrade between 11:30pm EST and 1:00 AM EST https://windmill.betteruptime.com/incident/602274 Fri, 13 Jun 2025 03:30:12 -0000 https://windmill.betteruptime.com/incident/602274#2c37d66beb93394eb3f22be9d6039b1fcc3592cf87c45b0e4e83e4d358ad6fc5 We will be performing a database upgrade between 11:30pm EST and 1:00 AM EST https://windmill.betteruptime.com/incident/601962 Thu, 12 Jun 2025 22:35:00 -0000 https://windmill.betteruptime.com/incident/601962#a52fc7cb7243318dbdf9be5d67ec90cb5322a5dba9680b78e0f25e7684cc26f0 Provider outages have resolved and service has returned to normal. https://windmill.betteruptime.com/incident/601962 Thu, 12 Jun 2025 22:35:00 -0000 https://windmill.betteruptime.com/incident/601962#a52fc7cb7243318dbdf9be5d67ec90cb5322a5dba9680b78e0f25e7684cc26f0 Provider outages have resolved and service has returned to normal. https://windmill.betteruptime.com/incident/601962 Thu, 12 Jun 2025 19:11:00 -0000 https://windmill.betteruptime.com/incident/601962#ad18a04a942082cc6b15fd40cef7a72aa5ffd35d605ce785fb1bf6f97eec2da7 Due to global outages with AWS, GCP, we are experiencing degraded performance throughout the stack https://windmill.betteruptime.com/incident/601962 Thu, 12 Jun 2025 19:11:00 -0000 https://windmill.betteruptime.com/incident/601962#ad18a04a942082cc6b15fd40cef7a72aa5ffd35d605ce785fb1bf6f97eec2da7 Due to global outages with AWS, GCP, we are experiencing degraded performance throughout the stack https://windmill.betteruptime.com/ Thu, 12 Jun 2025 18:56:28 +0000 https://windmill.betteruptime.com/#a085cb17935d0b40fcee8438c9f1a6fd2dbeebd1a3eab459d23e881de26d0617 Integration Syncing recovered https://windmill.betteruptime.com/ Thu, 12 Jun 2025 18:40:48 +0000 https://windmill.betteruptime.com/#a085cb17935d0b40fcee8438c9f1a6fd2dbeebd1a3eab459d23e881de26d0617 Integration Syncing went down https://windmill.betteruptime.com/incident/504161 Thu, 30 Jan 2025 06:00:00 -0000 https://windmill.betteruptime.com/incident/504161#f22daf13c6248d6289faeb97884b6257c207e7bf90ca200dd8f16eccf03a7151 Maintenance completed https://windmill.betteruptime.com/incident/504161 Thu, 30 Jan 2025 02:00:00 -0000 https://windmill.betteruptime.com/incident/504161#2e2d69a31707f66e4a1c8f030972d309d2afc49eee4ede2d42e9e8dc1888a69a The system will be undergoing db upgrades from 9PM EST to 1AM EST 2025/01/29 to 2025/01/30. During this time, the website and API will be in readonly mode. https://windmill.betteruptime.com/incident/500763 Thu, 23 Jan 2025 18:02:00 -0000 https://windmill.betteruptime.com/incident/500763#3f6396f53352ab9c16471d016e113299a14f33c85930b0835679e23009543708 All services have been restored https://windmill.betteruptime.com/incident/500763 Thu, 23 Jan 2025 17:12:00 -0000 https://windmill.betteruptime.com/incident/500763#79d100a822ba7358835b57c6711a09660beedcde92f88338a8fe4c2f2cd67fed We have a partial restoration of services on our write database. We are still working on restoring service to our read database. https://windmill.betteruptime.com/incident/500763 Thu, 23 Jan 2025 16:07:00 -0000 https://windmill.betteruptime.com/incident/500763#0062bd1149884d513ef42f26dccbb62d941ec6835f45d87512619ecf55fec0d4 All services are currently impaired due to our database providers certificate management service experiencing an error and reissuing all user-facing certificates. https://status.timescale.com/issues/67926cbc10bdfb3f068d82ac