Particle Health

Cyber and operational findings

Analyst-reviewed records. The grade states how well the cause is established; event, first public observation and acknowledgement are separate dates.

No public findings for this organisation.

Provider status posts

Collected from the organisation's own public status page. These are its words; DFX adds only the wording classification.

• Workbench Query Processing Slowdown and elevated error ratesOct 23 02:16 UTC · resolved
  Service restricted or degradedRestoration reported
  1. Oct 23 02:16 UTC identified: One of our third party dependency (our EMPI) is having issues which is affecting us. We are continuing accepting new queries, but we have paused querying the networks temporarily until the dependency comes back. While we are able to download files, the file validation is...
  2. Oct 23 02:16 UTC identified: We are continuing to work on a fix for this issue.
  3. Oct 23 02:43 UTC monitoring: The third party service is coming back up.
  4. Oct 23 02:47 UTC resolved: We are back online, and started processing queued up queries as of about 10 minutes ago.
  View on the provider's status page
• Elevated likelyhood of issues due to outage in one of GCP availability zonesSep 1 16:56 UTC · resolved
  Service restricted or degradedRestoration reported
  1. Sep 1 16:56 UTC monitoring: Hello, GCP is having issues in one of their availability zones (us-central1-b). Our systems are designed to be resilient to such failures. As far as we can tell our systems are operating normally and are sending this as informational notice. We did see some sporadic issues...
  2. Sep 1 19:21 UTC resolved: Wanted to let you know that the GCP issue has been marked as resolved by Google.
  View on the provider's status page
• Commonwell Service DisruptionAug 5 15:59 UTC · resolved · critical impact
  Service restricted or degradedInvestigation mentionedRestoration reported
  1. Aug 5 15:59 UTC monitoring: We wanted to let you know that we received notice that Commonwell is investigating a service disruption. It began at approximately 11:13 AM ET, and affects all document retrieval from Commonwell only. All Particle systems are functioning normally.
  2. Aug 5 21:31 UTC resolved: All services have been restored as of 2:55 PM ET, and CommonWell is operating normally.
  View on the provider's status page
• Data Processing Delays for Workbench FLAT and FHIRMay 21 17:48 UTC · resolved
  Service restricted or degradedInvestigation mentionedRestoration reported
  1. May 21 17:48 UTC investigating: We are currently investigating slowdown in data processing, this should affect Workbench FHIR and FLAT customers.
  2. May 21 18:03 UTC monitoring: We found the issue and reprocessing has resumed. We are back to operational state though some lingering delays could still be happening. We are continuing to monitor the system.
  3. May 21 18:17 UTC resolved: This incident has been resolved.
  View on the provider's status page
• Degraded Query Performance affecting all Particle customersApr 1 01:22 UTC · resolved
  Service restricted or degradedInvestigation mentionedRestoration reported
  1. Apr 1 01:22 UTC investigating: Network queries are currently taking longer to complete than what is typical. This is currently affecting all Particle customers as query complete notifications, transition alerts, and new encounter alerts will be delayed in processing and being sent. We are actively...
  2. Apr 1 04:47 UTC monitoring: We believe we identified the issue and the system no longer has elevated latency. We will continue monitoring for the next few hours, but we expect the latency to be back to normal.
  3. Apr 2 04:07 UTC resolved: This incident has been resolved.
  View on the provider's status page
• Degraded Query Performance affecting Workbench customersMar 15 14:33 UTC · resolved · major impact
  Service restricted or degradedRestoration reported
  1. Mar 15 14:33 UTC investigating: Yesterday we noticed that we had degraded performance for Workbench customers from around 8pm NY time on Friday to around 9pm on Saturday due to connectivity issues with CareQuality and CommonWell.  We have initiated a recovery protocol and have reran the affected queries so...
  2. Mar 15 14:34 UTC identified: The issue has been identified and a fix is being implemented.
  3. Mar 15 15:15 UTC monitoring: The system is fully operational across all product lines. All CCDA data from queries has been reprocessed and can be retrieved. We are reprocessing the data and monitoring the system.
  4. Mar 15 17:16 UTC resolved: We finished reprocessing data for FHIR and FLAT customers. Resolving the incident. Please work with your Customer Success representative if you have any questions. You should be able to retrieve data using the APIs you always use.
  View on the provider's status page
• Particle Health is experiencing degraded product performanceJan 6 23:08 UTC · resolved · minor impact
  Service restricted or degradedInvestigation mentionedRestoration reported
  1. Jan 6 23:08 UTC monitoring: We are investigating degraded performance with Production API
  2. Jan 12 15:14 UTC resolved: This incident has been resolved.
  View on the provider's status page
• Elevated Error Rates on Our V1 Data Processing Pipeline and FHIR PipelineNov 13 18:57 UTC · resolved
  Investigation mentionedRestoration reported
  1. Nov 13 18:57 UTC identified: We have been seeing elevated error rates for our advanced products customers using our V1 pipeline and FHIR pipeline. This issue does not affect most Signal customers or customers using our V2 Data Processing pipeline or V2 APIs. We believe we identified a root cause and...
  2. Nov 13 20:39 UTC monitoring: We rolled out a fix and are monitoring the results.
  3. Nov 15 01:57 UTC resolved: We consider this incident resolved - we confirmed that the fix we rolled out yesterday resolved the issue. After investigating further, we believe the issue was specific to Arizona. An endpoint there started to return embedded CCDAs encoded as base64 characters, which caused...
  View on the provider's status page
• Issue with Creating Patients using Patients APIJun 16 20:25 UTC · resolved · minor impact
  Restoration reported
  1. Jun 16 20:25 UTC investigating: Patients API is currently experiencing issues with creating patients, which can affect Deltas API, or Bi-Directionality, both in partial ways. We are working on a fix, and will update as soon as it's rolled out.
  2. Jun 16 20:41 UTC resolved: This incident has been resolved.
  View on the provider's status page
• Google Cloud Provider outageJun 12 18:24 UTC · resolved · critical impact
  Service restricted or degradedRestoration reported
  1. Jun 12 18:24 UTC monitoring: Particle is actively monitoring an outage with Google Cloud Provider affecting all Particle service. We will update the status as soon as the Google incident is resolved.
  2. Jun 12 18:26 UTC monitoring: We are continuing to monitor for any further issues.
  3. Jun 12 21:05 UTC monitoring: Google Cloud Platform posted an update that the region where we are hosted is starting to come back up. We are continuing to monitor the situation and will continue providing updates.
  4. Jun 12 21:07 UTC monitoring: We are now seeing queries go through successfully. We are continuing to monitor the situation.
  5. Jun 12 21:26 UTC monitoring: We are declaring the incident to be over. We have confirmed that all systems have gone back to normal processing, starting with about 4:45 pm Eastern time. Since then our system has been operating normally.
  6. Jun 12 21:29 UTC resolved: This incident has been resolved.
  View on the provider's status page
• Cloud Provider Networking IssueJan 8 15:44 UTC · resolved · minor impact
  Investigation mentionedRestoration reported
  View on the provider's status page
• FHIR and FLAT query processing delaysDec 11 23:17 UTC · resolved · major impact
  Service restricted or degradedRestoration reported
  View on the provider's status page
• Query processing queue delaysAug 20 14:55 UTC · resolved
  Service restricted or degradedRestoration reported
  View on the provider's status page
• Commonwell OutageFeb 22 19:21 UTC · resolved · major impact
  Service restricted or degradedRestoration reported
  View on the provider's status page
• Files API Issue resolvedDec 20 01:30 UTC · resolved
  Restoration reported
  View on the provider's status page
• Particle Health is experiencing degraded product performanceOct 19 21:35 UTC · resolved · minor impact
  Service restricted or degradedInvestigation mentionedRestoration reported
  View on the provider's status page
• Developer Portal Signups Not WorkingOct 5 18:00 UTC · resolved
  No classified wording
  View on the provider's status page
• We're monitoring reported issues with our Patients APIsAug 15 13:05 UTC · resolved · major impact
  Service restricted or degradedRestoration reported
  View on the provider's status page
• Reduced performance with our Patient Upload, Patient Query and Download FlowJun 8 11:53 UTC · resolved · major impact
  Service restricted or degradedInvestigation mentionedRestoration reported
  View on the provider's status page
• Athena Health Responding Gateway DisruptionMar 23 14:03 UTC · resolved
  Service restricted or degradedRestoration reported
  View on the provider's status page
• New Credential Creation in Developer Portal - No Impact on Ongoing QueriesMar 14 18:04 UTC · resolved · minor impact
  No classified wording
  View on the provider's status page
• Monitoring fix for intermittent failures in Query APIMar 10 15:11 UTC · resolved · major impact
  Investigation mentionedRestoration reported
  View on the provider's status page
• Files API Returning 204 ErrorJan 5 20:42 UTC · resolved · major impact
  Restoration reported
  View on the provider's status page
• Developer Portal InterruptionsDec 12 15:55 UTC · resolved · major impact
  Service restricted or degradedSign-in disruptionRestoration reported
  View on the provider's status page
• Developer Portal InterruptionsDec 7 14:22 UTC · resolved · minor impact
  Service restricted or degradedSign-in disruptionRestoration reported
  View on the provider's status page