Skip to main content

Check the flows processed

In order for the to make sure the flows processed are up to date. Someone will be checking 2 times a week to make sure the flow files are being processed. There will be 3 locations that will be checked. Orsanco RSMS website, Flows on the ORSANCO VM, and Flows on MSI server. Melissa will be in charge of checking 2 times a week.

Simple Instructions

Check RSMS

  1. Open https://rsms.hydrotrek.com/
  2. Sign in U: user@gqc.com and P: Demogqc2@24
  3. Navigate to the Flows page
  4. Scroll to the bottom and make note of the "Last HEC_RAS file processed" date: RSMS Flows Last File Processed

Check Ohio River Flows

  1. Open https://ohioriver.gqc.com/
  2. Navigate to the Map page
  3. Click on any of the blue markers (stations)
  4. Navigate to the Daily Flows page
  5. Change the Date Start to something within the past month
  6. Click Apply to update the graph
  7. Make note of the maximum Date value in the graph: River flow graph max date

Known Issues

Remote Server (data7) Fingerprint Changed

Sometimes the fingerprint for the remote host will change. This means that our downloader will stop working because it sees the SSH connection as potentially insecure. To resolve this you will need to remove the old fingerprint from known_hosts and add the new fingerprint in its place.

Remove the old fingerprints with this command:

ssh-keygen -f "/home/gqc/.ssh/known_hosts" -R "data7.erh.noaa.gov"

Add the new fingerprints by connecting with SSH with this command:

ssh skshirsagar@data7.erh.noaa.gov

NOTE - it's okay if the connection fails, the important part is that it asks if you want to add the fingerprint and you type yes.

Flow Check

LDA is Last Date Available

Date CheckedRSMS DateFlows Orsanco VMFlows MicrocenterFlows Website LDAChecked ByNotes

| 08/11/2025 | 2025-08-10 | 2025-08-10 | 2025-08-10 | 2025-08-20 | Jake | | | 08/04/2025 | 2025-07-30 | 2025-07-30 | 2025-07-30 | 2025-08-09 | Jake | | | 07/16/2025 | 2025-07-15 | 2025-07-15 | 2025-07-15 | 2025-07-25 | Melissa | | | 07/14/2025 | 2025-07-13 | 2025-07-13 | 2025-07-13 | 2025-07-23 | Melissa | | | 07/10/2025 | 2025-07-09 | 2025-07-09 | 2025-07-09 | 2025-07-19 | Melissa | | | 05/27/2025 | 2025-05-27 | 2025-05-27 | 2025-05-27 | 2025-06-05 | Jake | | | 05/15/2025 | 2025-05-14 | 2025-05-14 | 2025-05-14 | 2025-05-24 | Jake | | | 04/21/2025 | 2025-04-20 16:30 GMT | 2025-04-20 17:08 | 2025-04-20 13:37 | 04/30/2025 | Jake | | | 04/14/2025 | 2025-04-13 16:31 GMT | 2025-04-13 17:13 | 2025-04-13 13:37 | 04/23/2025 | Jake | | | 04/09/2025 | 2025-04-09 16:31 GMT | 2025-04-09 17:09 | 2025-04-09 13:43 | 04/19/2025 | Jake | | | 04/03/2025 | 2025-04-02 16:31 GMT | 2025-04-02 17:14 | 2025-04-02 13:39 | 04/12/2025 | Jake | | | 03/26/2025 | 2025-03-26 16:30 GMT | 2025-03-26 17:14 | 2025-03-26 13:40 | 04/05/2025 | Jake | | | 03/21/2025 | 2025-03-20 16:30 GMT | 2025-03-20 17:09 | 2025-03-20 13:39 | 03/30/2025 | Jake | | | 03/17/2025 | 2025-03-16 16:30 GMT | 2025-03-16 17:12 | 2025-03-16 13:38 | 03/26/2025 | Jake | | | 03/12/2025 | 2025-03-11 16:31 GMT | 2025-03-11 17:06 | 2025-03-11 13:39 | 03/21/2025 | Jake | | | 03/06/2025 | 2025-03-05 17:30 GMT | 2025-03-05 17:10 | 2025-03-05 13:39 | 03/15/2025 | Melissa | | | 03/05/2025 | 2025-03-04 17:30 GMT | 2025-03-04 17:10 | 2025-03-04 13:39 | 03/14/2025 | Melissa | | | 03/04/2025 | 2025-03-03 17:30 GMT | 2025-03-03 17:14 | 2025-03-03 13:39 | 03/13/2025 | Melissa | | | 02/25/2025 | 2025-02-24 17:31 GMT | 2025-02-24 17:10 | 2025-02-24 13:44 | 03/09/2025 | Melissa | | | 02/20/2025 | 2025-02-19 17:31 GMT | 2025-02-19 17:11 | 2025-02-19 13:40 | 03/01/2025 | Jake | | | 02/13/2025 | 2025-02-12 17:30 GMT | 2025-02-12 17:09 | 2025-02-12 13:42 | 02/22/2025 | Jake | | | 01/27/2025 | 2025-01-27 17:30 GMT | 2025-01-26 16:17 | 2025-01-27 13:39 | 02/5/2025 | Jake | First check since switch from password to ssh key | | 01/22/2025 | 2024-01-20 17:30 GMT | 2024-01-22 16:10 | 2024-01-22 13:39 | 01/25/2025 | Melissa | Reported to Jake | | 01/17/2025 | 2024-01-17 17:30 GMT | 2024-01-15 15:15 | 2024-01-15 11:09 | 01/24/2025 | Melissa | Reported to Jake | | 01/13/2025 | 2024-01-13 17:30 GMT | 2024-01-12 15:15 | 2024-12-18 13:38 | 01/24/2025 | Melissa | Reported to Jake | | 01/10/2025 | 2024-01-10 17:31 GMT | 2024-01-10 15:08 | 2024-12-18 13:38 | 01/19/2025 | Melissa | Reported to Jake | | 01/08/2025 | 2024-01-06 17:31 GMT | | | 01/16/2025 | Melissa | testing RSMS | | 12/09/2024 | 2024-12-09 17:30 GMT | 2024-12-08 15:15 | 2024-12-09 13:39 | 12/22/2024 | Melissa | | | 12/04/2024 | 2024-12-04 17:30 GMT | 2024-12-04 15:08 | 2024-12-04 13:37 | 12/18/2024 | Melissa | | | 11/27/2024 | 2024-11-27 17:30 GMT | 2024-11-27 15:09 | 2024-11-27 13:38 | 12/09/2024 | Melissa | | | 11/15/2024 | 2024-11-15 17:30 GMT | 2024-11-15 15:07 | 2024-11-15 13:38 | 11/24/2024 | Melissa | | | 11/13/2024 | 2024-11-13 17:30 GMT | 2024-11-13 15:08 | 2024-11-13 13:39 | 11/22/2024 | Melissa | | | 11/11/2024 | 2024-11-11 17:31 GMT | 2024-11-11 15:07 | 2024-11-11 13:37 | 11/20/2024 | Melissa | | | 11/04/2024 | 2024-11-04 17:30 GMT | 2024-11-04 15:08 | 2024-11-04 13:37 | 11/14/2024 | Melissa | | | 11/01/2024 | 2024-10-31 16:31 GMT | 2024-11-31 15:08 | 2024-11-31 13:37 | 11/10/2024 | Melissa | | | 10/28/2024 | 2024-10-28 16:30 GMT | 2024-10-28 15:08 | 2024-10-28 13:37 | 11/07/2024 | Melissa | | | 10/25/2024 | 2024-10-24 16:31 GMT | 2024-10-24 15:07 | 2024-10-24 13:37 | 11/06/2024 | Melissa | | | 10/21/2024 | 2024-10-20 16:31 GMT | 2024-10-21 15:07 | 2024-10-20 13:37 | 10/31/2024 | Melissa | | | 10/16/2024 | 2024-10-16 16:31 GMT | 2024-10-16 15:07 | 2024-10-15 13:37 | 10/26/2024 | Melissa | | | 10/14/2024 | 2024-10-14 16:31 GMT | 2024-10-14 15:13 | 2024-10-14 13:37 | 10/24/2024 | Melissa | | | 10/11/2024 | 2024-10-11 16:31 GMT | 2024-10-11 15:07 | 2024-10-11 13:37 | 10/21/2024 | Melissa | | | 10/9/2024 | 2024-10-09 16:31 GMT | 2024-10-09 15:13 | 2024-10-09 13:37 | 10/19/2024 | Melissa | | | 10/7/2024 | 2024-10-07 16:31 GMT | 2024-10-07 15:13 | 2024-10-07 13:37 | 10/17/2024 | Melissa | | | 10/4/2024 | 2024-10-04 16:31 GMT | 2024-10-04 15:07 | 2024-10-04 13:37 | 10/11/2024 | Melissa | | | 9/30/2024 | 2024-09-30 16:31 GMT | 2024-09-30 15:23 | 2024-09-24 13:38 | 10/9/2024 | Melissa | | | 9/13/2024 | 2024-09-13 16:30 GMT | 2024-09-13 15:08 | 2024-09-13 13:37 | 9/23/2024 | Melissa | | | 9/11/2024 | 2024-09-11 16:30 GMT | 2024-11-05 15:08 | 2024-09-11 13:37 | 9/21/2024 | Melissa | | | 9/9/2024 | 2024-09-09 16:31 GMT | 2024-09-09 09:07 | 2024-09-09 13:37 | 9/19/2024 | Melissa | | | 9/5/2024 | 2024-09-05 16:30 GMT | 2024-09-05 15:07 | 2024-09-05 13:37 | 9/15/2024 | Melissa | | | 8/30/2024 | 2024-08-30 16:30 GMT | 2024-08-29 15:08 | 2024-08-30 13:37 | 9/8/2024 | Melissa | | | 8/28/2024 | 2024-08-19 16:31 GMT | 2024-08-28 15:08 | 2024-08-27 13:37 | 9/7/2024 | Melissa | | | 8/22/2024 | 2024-08-19 16:31 GMT | 2024-08-21 15:08 | 2024-08-22 13:37 | 9/2/2024 | Melissa | | | 8/15/2024 | 2024-08-14 16:30 GMT | 2024-08-14 15:08 | 2024-08-14 13:37 | 8/25/2024 | Melissa | | | 8/12/2024 | 2024-08-12 16:30 GMT | 2024-08-11 15:12 | 2024-08-12 13:37 | 8/25/2024 | Melissa | | | 8/9/2024 | 2024-08-09 16:30 GMT | 2024-08-09 15:06 | 2024-08-09 13:37 | 8/18/2024 | Melissa | | | 8/7/2024 | 2024-08-07 16:30 GMT | 2024-08-07 15:06 | 2024-08-07 13:37 | 8/17/2024 | Melissa | | | 8/5/2024 | 2024-08-05 16:30 GMT | 2024-08-05 15:06 | 2024-08-05 13:36 | 8/15/2024 | Melissa | | | 7/31/2024 | 2024-07-29 16:30 GMT | 2024-07-29 15:07 | 2024-07-31 13:37 | 8/10/2024 | Melissa | | | 7/25/2024 | 2024-07-25 16:30 GMT | 2024-07-25 15:07 | 2024-07-25 13:37 | 8/6/2024 | Melissa | | | 7/22/2024 | 2024-07-22 16:30 GMT | 2024-07-22 15:05 | 2024-07-21 13:37 | 7/31/2024 | Melissa | | | 7/19/2024 | 2024-07-18 16:31 GMT | 2024-07-18 15:07 | 2024-07-18 13:37 | 7/28/2024 | Melissa | | | 7/17/2024 | 2024-07-16 16:31 GMT | 2024-07-17 15:07 | 2024-07-16 13:37 | 7/27/2024 | Melissa | | | 7/15/2024 | 2024-07-14 16:30 GMT | 2024-07-14 15:06 | 2024-07-14 13:37 | 7/27/2024 | Melissa | | | 7/12/2024 | 2024-07-11 16:31 GMT | 2024-07-11 13:37 | 2024-07-11 15:06 | 7/22/2024 | Melissa | One timestep on the 23rd| | 7/1/2024 | 2024-06-30 16:31 GMT | 2024-07-01 15:04 | 2024-06-30 13:37 | 7/14/2024 | Melissa | One timestep on the 15th| | 6/10/2024 | 2024-06-10 16:30 GMT | 2024-06-07 22:35 | 2024-06-09 13:37 | 6/08/2024 | Melissa | One timestep on the 9th| | 6/7/2024 | 2024-06-06 16:30 GMT | 2024-05-15 15:07 | 2024-05-15 13:37 | 5/24/2024 | Melissa | One timestep on the 25th| | 5/20/2024 | 2024-05-20 16:30 GMT | 2024-05-15 15:07 | 2024-05-15 13:37 | 5/24/2024 | Melissa | One timestep on the 25th| | 5/13/2024 | 2024-05-13 16:31 GMT | 2024-05-13 15:13 | 2024-05-13 13:37 | 5/22/2024 | Melissa | One timestep on the 23rd| | 5/10/2024 | 2024-05-09 16:30 GMT | 2024-05-09 15:04 | 2024-05-09 13:37 | 5/18/2024 | Melissa | One timestep on the 19th| | 5/6/2024 | 2024-05-06 16:30 GMT | 2024-05-06 15:06 | 2024-05-06 13:34 | 5/15/2024 | Melissa | | | 5/2/2024 | 2024-05-02 16:30 GMT | 2024-05-02 15:03 | 2024-05-02 13:34 | 5/13/2024 | Melissa | | | 4/29/2024 | 2024-04-29 16:30 GMT | 2024-04-29 13:34 | 2024-04-29 15:03 | 5/13/2024 | Melissa | | | 4/25/2024 | 2024-04-25 16:30 GMT | 2024-04-23 15:22 | 2024-04-25 13:35 | 5/7/2024 | Melissa | | | 4/22/2024 | 2024-04-22 16:32 GMT | 2024-04-22 15:35 | 2024-04-22 13:47 | 5/6/2024 | Melissa | | | 4/19/2024 | 2024-04-15 16:31 GMT | 2024-04-19 15:19 | 2024-04-18 13:45 | 5/2/2024 | Melissa | | | 4/15/2024 | 2024-04-15 16:31 GMT | 2024-04-15 15:15 | 2024-04-15 13:43 | N/A | Melissa | | | 4/12/2024 | 2024-04-11 16:31 GMT | 2024-04-11 15:10 | 2024-04-11 13:40 | N/A | Melissa | | | 4/8/2024 | 2024-04-06 16:33 GMT | 2024-04-06 15:21 | 2024-04-06 13:43 | N/A | Melissa | | | 4/4/2024 | 2024-03-31 16:33 GMT | 2024-03-26 20:06 | 2024-03-26 13:38 | N/A | Melissa | | | 4/1/2024 | 2024-03-31 16:33 GMT | 2024-03-26 20:06 | N/A | 2024-03-31 13:38 | Melissa |Nothing past the 25th. | | 3/29/2024 | 2024-03-25 16:30 GMT | 2024-03-26 20:06 | N/A | 2024-03-25 13:34 | Melissa |Nothing past the 25th. | | 3/26/2024 | 2024-03-25 16:30 GMT | 2024-03-24 20:05 | N/A | 2024-03-25 13:34 | Melissa | Dell & Orsanco VM are out of date. | | 03/22/2024 | 2024-03-22 16:30 GMT | 2024-03-21 20:10 | 2024-03-15 10:37 | N/A | Melissa | The MM is not updated.| | 03/19/2024 | 2024-03-15 16:30 GMT | 2024-03-15 20:05 | 2024-03-15 10:37 | N/A | Melissa | There is nothing after the 15th | | 03/15/2024 | 2024-03-14 16:30 GMT | 2024-03-14 20:07 | 2024-03-13 10:38 | N/A | Melissa | The MM is not running everyday. No file on the 12th. | | 03/11/2024 | 2024-03-10 16:31 GMT | 2024-03-10 20:07 | 2024-03-10 10:36 | N/A | Melissa | The MM is behind 1 day as of 3/8.| | 03/07/2024 | 2024-03-07 17:30 GMT | 2024-03-07 20:08 | 2024-03-07 10:38 | N/A | Melissa | | | 03/04/2024 | 2024-03-04 17:30 GMT | 2024-03-04 20:07 | 2024-03-04 10:38 | N/A | Melissa | | | 02/29/2024 | 2024-02-29 17:30 GMT | 2024-02-28 20:09 | 2024-02-29 10:37 | N/A | Melissa | | | 02/26/2024 | 2024-02-25 17:30 GMT | 2024-02-25 20:08 | 2024-02-25 10:38 | N/A | Melissa | | | 02/22/2024 | 2024-02-22 17:30 GMT | 2024-02-22 20:08 | 2024-02-22 10:37 | N/A | Melissa | | | 02/15/2024 | 2024-02-14 17:30 GMT | 2024-02-14 20:07 | 2024-02-15 10:34 | N/A | Melissa | | | 02/12/2024 | 2024-02-11 17:30 GMT | 2024-02-11 20:06 | 2024-02-11 10:37 | N/A | Melissa | |

How to check the flows processed

Check Daily Flow Count in the DB

You can use this query to check daily flow counts. The results should be number of stations times the frequency. We recently switched the VM to store hourly instead of six-hour data, so there are (400 - 41) = 359 stations and 24 hours in a day, meaning we can expect 8,616 records per day.

Make sure you specify a :start_timestamp value. The results will return counts for every day after the specified :start_timestamp

SELECT
CAST((FlowDateTime / 86400) AS BIGINT) AS Day,
COUNT(*) AS RecordCount
FROM HEC_RASFlow
WHERE FlowDateTime >= :start_timestamp
GROUP BY CAST((FlowDateTime / 86400) AS BIGINT)
ORDER BY Day;

Check the ORSANCO Flows on the Website

Log into the following website http://rsms.hydrotrek.com/ Go to the Flows page. Scroll down to the bottom of the page and check the last HEC_RAS file processed. Recent Flows on ORSANCO Website

Check the Flows processed for Flows

Open a terminal and connect to the Orsanco VM. Connect to the database. Run the query to get the last 10 riverflows_flowfileprocessed. The commands are below.

ssh orsanco_vm
psql -d orsanco
select * from riverflows_flowfileprocessed order by date desc limit 10;

The results of the query should looks something like query_results

Do the same for the Microcenter machine.

ssh microcenter
psql -d orsanco
select * from riverflows_flowfileprocessed order by date desc limit 10;

Finally run the same check on the Microcenter machine. Micro center