What federal agencies plan to buy, from DHS and the GSA Acquisition Gateway, with GSA’s ceiling rates for every labor category on the Multiple Award Schedule and 7,335,883 reported federal subawards from fiscal 2016 through 2027, plus 6,293,287 state and city contract awards and the organizations doing business with New York City, updated weekly.
A forecast is an agency’s public notice of a purchase it plans to make, usually months before the solicitation. DHS publishes its forecasts in the Acquisition Planning Forecast System (planned buys over $250,000). The GSA Acquisition Gateway publishes forecasts from ten civilian agencies, with Interior, Agriculture and Commerce the largest. Civly reads both every week into one table, FORECASTS, with an estimated value range, NAICS code, set-aside, incumbent and planned award date where the agency gives them. A forecast that drops off a feed stays in the table, flagged.
LABOR_RATES has GSA’s CALC+ ceiling rates: the most each Multiple Award Schedule contractor may bill per hour for each labor category, with next-year and second-year prices.
SUBAWARDS adds 7,335,883 reports of federal subcontracts and subgrants from USASpending.gov, fiscal 2016 through 2027. Rows identify the prime recipient and subrecipient, their Unique Entity IDs (UEIs), the amount, agency, dates and work description. Revised reports are retained and marked.
STATE_CONTRACT_AWARDS adds 6,293,287 state and city contracts, purchase orders and awards from seven sources: the District of Columbia’s PASS contracts and purchase orders, Delaware, Virginia’s eVA system (fiscal 2018 on), the New Mexico Sunshine Portal (purchases from July 2021), Nevada ePro and Louisiana Checkbook. Rows name the vendor, the agency, the amount, the dates and what was bought, mapped into one set of columns. Coverage is limited to these seven sources. Other states are not included yet.
NYC_DOING_BUSINESS_ORGANIZATIONS and NYC_DOING_BUSINESS_PEOPLE list the 10,787 organizations New York City records as doing business with it and their 60,545 principals, by name and role, from NYC Doing Business (Mayor’s Office of Contract Services).
Common uses: building a federal sales pipeline (what is coming, when, how large, which set-aside, who holds the current contract), tracking recompetes, finding teaming partners and competitors, pricing a bid against published ceiling rates, and seeing who already sells to state agencies and to New York City.
| Fact | Detail |
|---|---|
| Source | Federal: DHS Acquisition Planning Forecast System, GSA Acquisition Gateway forecast tool, GSA CALC+ ceiling rates, and USASpending.gov federal subaward reports, all U.S. government works. State and city: District of Columbia PASS contracts and purchase orders (Office of Contracting and Procurement), Delaware contracts, Virginia eVA (Department of General Services), New Mexico Sunshine Portal purchases, Nevada ePro contracts and Louisiana Checkbook contracts. New York City: NYC Doing Business (Mayor’s Office of Contract Services) |
| Coverage | Forecasts from DHS and the ten civilian agencies on the Acquisition Gateway. Ceiling rates for every labor category on the Multiple Award Schedule. Federal subcontract and subgrant reports from fiscal 2016 through 2027. State and city contract awards from the District of Columbia, Delaware, Virginia (fiscal 2018 on), New Mexico (from July 2021), Nevada and Louisiana only. Organizations doing business with New York City and their principals |
| Refresh | Weekly |
| Free trial | 30 days: the DHS forecasts (SOURCE = 'dhs_apfs'), the labor rates whose CATEGORY includes Facilities, fiscal 2016 subawards (659,070 reports), and the Delaware, Nevada and Louisiana contract awards (15,241 rows). The NYC Doing Business tables return no rows during the trial |
| Subscription | Every forecast, labor rate, subaward fiscal year and state contract source, plus both NYC Doing Business tables |
| Join key | Forecasts and labor rates share no key. FORECASTS.NORM_INCUMBENT_NAME and LABOR_RATES.NORM_VENDOR_NAME use the same name rule, so a forecast’s incumbent can be matched to its ceiling rates. NYC_DOING_BUSINESS_PEOPLE joins NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME. The state contract and NYC tables share no id with the federal tables. Match them by name. |
| Permitted use | Not for employment, tenant, credit, insurance or licensing decisions about a person. |
Row counts checked October 27, 2026. State contract and NYC Doing Business counts checked November 15, 2026. Counts include superseded subaward reports.
| Table | Source | Rows | Free trial |
|---|---|---|---|
FORECASTS | DHS Acquisition Planning Forecast System (dhs_apfs) | 666 | Included |
FORECASTS | GSA Acquisition Gateway, ten civilian agencies (acquisition_gateway) | 12,153 | Subscription only |
LABOR_RATES | GSA CALC+ ceiling rates, Multiple Award Schedule | 346,801 | Categories that include Facilities |
SUBAWARDS | USASpending.gov, fiscal 2016 through 2027 | 7,335,883 | Fiscal 2016 only: 659,070 reports |
STATE_CONTRACT_AWARDS | District of Columbia PASS contracts (dc_contracts) | 20,108 | Subscription only |
STATE_CONTRACT_AWARDS | District of Columbia PASS purchase orders (dc_purchase_orders) | 255,170 | Subscription only |
STATE_CONTRACT_AWARDS | Delaware contracts (de_contracts) | 1,043 | Included |
STATE_CONTRACT_AWARDS | Virginia eVA, fiscal 2018 on (va_eva) | 5,559,637 | Subscription only |
STATE_CONTRACT_AWARDS | New Mexico Sunshine Portal purchases, from July 2021 (nm_sunshine_purchases) | 443,131 | Subscription only |
STATE_CONTRACT_AWARDS | Nevada ePro contracts (nv_nevadaepro_contracts) | 4,292 | Included |
STATE_CONTRACT_AWARDS | Louisiana Checkbook contracts (la_checkbook_contracts) | 9,906 | Included |
NYC_DOING_BUSINESS_ORGANIZATIONS | NYC Doing Business, Mayor’s Office of Contract Services | 10,787 | Subscription only |
NYC_DOING_BUSINESS_PEOPLE | NYC Doing Business, Mayor’s Office of Contract Services | 60,545 | Subscription only |
Reading the data
A forecast is a plan, not an award, a solicitation or a promise to buy. Agencies change dates, values and set-asides, or drop the purchase. The binding terms come with the solicitation on SAM.gov.
Use LISTED_IN_LATEST_FEED = TRUE for what agencies plan now. A forecast that leaves a feed stays with LISTED_IN_LATEST_FEED = FALSE. FIRST_SEEN_DATE and LAST_SEEN_DATE are the dates of Civly’s weekly reads, not the agency’s dates.
DHS gives an exact planned award date. The Acquisition Gateway usually gives a fiscal year and sometimes a quarter. PLANNED_AWARD_WINDOW_START and PLANNED_AWARD_WINDOW_END let you filter both together.
Dates outside 2015 to 2060 are typing errors or placeholders in the source (such as 2099-09-08) and are left empty, never corrected.
A ceiling rate is the most a vendor may bill per hour for a labor category on that contract. Actual task-order prices are often lower. Labor category names are the vendors’ own wording, so compare within SIN or CATEGORY and read EDUCATION_LEVEL and MIN_YEARS_EXPERIENCE beside the price.
Subawards are reports from prime recipients. Revisions can repeat a subaward. Use IS_LATEST_REPORT = TRUE to count the newest report and AMOUNT_SUSPECT = FALSE before adding dollars. Flagged amounts fail Civly’s checks and remain in the file with a reason. The FISCAL_YEAR file year and SUBAWARD_ACTION_DATE_FISCAL_YEAR may differ.
In STATE_CONTRACT_AWARDS, AMOUNT means different things by source. Read AMOUNT_KIND before adding dollars, and do not add amounts of different kinds together: award_max is a contract’s value, po_total is a purchase order’s total, and spent_to_date is what has been spent under a contract so far, not its value.
NYC Doing Business prints its dates with short years, such as 07/03/0017 for a 2017 date. DOING_BUSINESS_START_DATE and DOING_BUSINESS_END_DATE are Civly’s reading of them as dates. The city’s own text is kept in the _AS_PUBLISHED columns.
Six tables, 187 columns in total: FORECASTS, LABOR_RATES, SUBAWARDS, STATE_CONTRACT_AWARDS, NYC_DOING_BUSINESS_ORGANIZATIONS and NYC_DOING_BUSINESS_PEOPLE. The same tables serve the trial and the subscription. During the free trial, FORECASTS returns the DHS forecasts, LABOR_RATES returns the categories that include Facilities, SUBAWARDS returns fiscal 2016, and STATE_CONTRACT_AWARDS returns the Delaware, Nevada and Louisiana rows. The two NYC Doing Business tables return no rows during the trial. A subscription adds the Acquisition Gateway forecasts, every other labor category, all subaward fiscal years, the District of Columbia, Virginia and New Mexico contract rows, and both NYC Doing Business tables.
FORECASTSOne row per forecast, from either source, with SOURCE and AGENCY columns. Text is kept as published apart from the columns marked as Civly’s. Named agency contacts are not included. 52 columns.
| Column | Type | Meaning |
|---|---|---|
SOURCE_ROW_NUMBER | NUMBER | Position of the row in Civly’s weekly file. |
ACQUISITION_PHASE | TEXT | Acquisition Gateway only: the purchase’s stage, as published. |
ADDITIONAL_INFORMATION | TEXT | Acquisition Gateway only: the agency’s added notes. Typed-in email addresses are replaced with [email removed]. |
AGENCY | TEXT | Department of Homeland Security for DHS forecasts. For Acquisition Gateway forecasts, the agency that published it. |
CONTRACT_TYPE | TEXT | Planned contract type, as published. |
CONTRACT_VEHICLE | TEXT | Planned contract vehicle or buying method, as published. |
CONTRACTING_AGENCY | TEXT | Acquisition Gateway only: the agency that will award the contract. |
CONTRACTING_OFFICE | TEXT | The office that will award the contract. |
CURRENT_CONTRACT_END_DATE | DATE | Acquisition Gateway only: when the current contract ends, when listed. |
DESCRIPTION | TEXT | The agency’s description of the purchase. Typed-in email addresses are replaced with [email removed]. |
ESTIMATED_VALUE_MAX_USD | NUMBER | Civly’s reading of the upper dollar amount in ESTIMATED_VALUE_RANGE. Empty for open-ended bands such as Over $100M, or when the label has no amount Civly can read. |
ESTIMATED_VALUE_MIN_USD | NUMBER | The lower dollar amount in the band, read the same way. 0 for bands such as Below $150K. |
ESTIMATED_VALUE_RANGE | TEXT | The agency’s value band, as published. A band, not a budget or an expected price. |
EXTENT_COMPETED | TEXT | Acquisition Gateway only: planned competition, as published. |
FORECAST_ID | TEXT | The agency’s own forecast number (the APFS number for DHS). |
INCUMBENT_CONTRACT_NUMBER | TEXT | Current contract number, when the agency lists one. Several are joined as a; b. |
INCUMBENT_NAME | TEXT | Current contractor, when listed. Placeholders such as TBD and N/A are left out, and several names are joined as a; b. Typed-in email addresses are replaced with [email removed]. |
NAICS_CODE | TEXT | Industry code (NAICS). The Acquisition Gateway shows only the first when a forecast has several. |
NAICS_CODE_COUNT | NUMBER | How many NAICS codes the agency listed. |
NAICS_DESCRIPTION | TEXT | Industry name, as published. |
NORM_INCUMBENT_NAME | TEXT | Civly’s normalized incumbent name, each name normalized separately, for matching. Same rule as LABOR_RATES.NORM_VENDOR_NAME. |
ORGANIZATION | TEXT | The agency component or funding organization, as published. |
PERIOD_OF_PERFORMANCE_END | DATE | Planned end of the work. |
PERIOD_OF_PERFORMANCE_START | DATE | Planned start of the work. |
PLACE_OF_PERFORMANCE_CITY | TEXT | Every city the forecast lists, as a; b. Not lined up with the state and country columns. |
PLACE_OF_PERFORMANCE_COUNT | NUMBER | How many places the forecast lists. Empty when the agency says the place cannot be disclosed. |
PLACE_OF_PERFORMANCE_COUNTRY | TEXT | Every country the forecast lists, as a; b. |
PLACE_OF_PERFORMANCE_STATE | TEXT | Every state the forecast lists, as a; b. A nationwide forecast lists all 62 states and territories. |
PLANNED_AWARD_DATE | DATE | DHS only: the planned award date. |
PLANNED_AWARD_FISCAL_YEAR | NUMBER | Federal fiscal year of the planned award. A fiscal year runs October 1 to September 30. |
PLANNED_AWARD_QUARTER | NUMBER | Fiscal quarter of the planned award, when given. |
PLANNED_AWARD_WINDOW_END | DATE | End of the planned award window (see PLANNED_AWARD_WINDOW_START). |
PLANNED_AWARD_WINDOW_START | DATE | Civly’s column, so both sources can be filtered together: the exact planned date when published, otherwise the fiscal quarter, otherwise the whole fiscal year. Empty when the agency gave no award year. |
PLANNED_SOLICITATION_DATE | DATE | When the agency plans to post the solicitation. |
REQUIREMENT_TYPE | TEXT | Civly’s mapping of the agency’s wording: new, recompete (a follow-on to an existing contract), option_exercise (Acquisition Gateway only), no_longer_required (DHS only) or other. Empty when the agency gave none. |
REQUIREMENT_TYPE_AS_PUBLISHED | TEXT | The agency’s own wording. |
REQUIREMENTS_OFFICE | TEXT | The office that needs the purchase. |
SET_ASIDE | TEXT | Small-business set-aside, in the agency’s wording (SB is small business, TBD is to be determined). |
SET_ASIDE_EXTENT | TEXT | DHS only: full or partial. |
SOLICITATION_URL | TEXT | Acquisition Gateway only: link to the solicitation, when posted. |
SOURCE | TEXT | dhs_apfs or acquisition_gateway. The trial returns dhs_apfs. |
SOURCE_CREATED_DATE | DATE | When the agency created the forecast. |
SOURCE_RECORD_ID | TEXT | The source system’s id for the forecast. Unique together with SOURCE. |
SOURCE_UPDATED_DATE | DATE | When the agency last changed the forecast. |
TITLE | TEXT | Forecast title. |
SOURCE_URL | TEXT | The feed the row was read from. |
SOURCE_SHA256 | TEXT | Checksum of the file read. |
SOURCE_RELEASE_DATE | DATE | Date of the read. |
FIRST_SEEN_DATE | DATE | Date of the first weekly read that found the forecast. Civly’s date, not the agency’s. |
LAST_SEEN_DATE | DATE | Date of the latest weekly read that found the forecast. |
LISTED_IN_LATEST_FEED | BOOLEAN | True when the latest read found the forecast. False means it has left the feed since LAST_SEEN_DATE, often because the solicitation was posted or the plan was dropped. It does not mean the contract was awarded. |
IMPORTED_AT | TIMESTAMP_NTZ | When Civly imported the row. |
LABOR_RATESOne row per labor category on one vendor’s GSA schedule contract, from one nightly CALC+ build. 26 columns.
| Column | Type | Meaning |
|---|---|---|
SOURCE_ROW_NUMBER | NUMBER | Position of the row in Civly’s weekly file. |
BUSINESS_SIZE | TEXT | S for a small business, O for other than small. |
CATEGORY | TEXT | Multiple Award Schedule category, as published. The trial returns categories that include Facilities. |
CONTRACT_END | DATE | Contract end date. |
CONTRACT_NUMBER | TEXT | GSA contract number. One contract carries many rates, and one vendor can hold several contracts. |
CONTRACT_START | DATE | Contract start date. |
CONTRACT_TERMINATION_DATE | DATE | Published by CALC+ without a definition and set on few contracts. Read it as published. |
CURRENT_PRICE | NUMBER | Ceiling hourly rate for the contract’s current year, dollars: the most the vendor may bill, not a price anyone paid. |
DATA_SOURCE | TEXT | CALC+’s own source label for the rate, as published. |
EDUCATION_LEVEL | TEXT | Minimum education for the labor category, in the vendor’s wording. |
LABOR_CATEGORY | TEXT | The vendor’s name for the job. The same job appears under many names. |
MIN_YEARS_EXPERIENCE | NUMBER | Minimum years of experience the vendor sets for the category. |
NEXT_YEAR_PRICE | NUMBER | Ceiling rate for the contract’s next year. Empty when none is published. |
NORM_VENDOR_NAME | TEXT | Civly’s normalized vendor name, for matching. Same rule as FORECASTS.NORM_INCUMBENT_NAME. |
RATE_ID | NUMBER | CALC+’s id for the rate. |
SCHEDULE | TEXT | GSA schedule. MAS (Multiple Award Schedule) on every row as of October 5, 2026. |
SECOND_YEAR_PRICE | NUMBER | Ceiling rate for the year after next. Empty when none is published. |
SECURITY_CLEARANCE | BOOLEAN | Whether the labor category requires a security clearance. |
SIN | TEXT | Special Item Number: the part of the schedule the rate is offered under. |
SUBCATEGORY | TEXT | Schedule subcategory, as published. |
VENDOR_NAME | TEXT | Contractor name, as published. |
WORKSITE | TEXT | Where the work is done, in the vendor’s wording (the contractor’s site, the customer’s, or both). |
SOURCE_URL | TEXT | The CALC+ address the rates were read from. |
SOURCE_SHA256 | TEXT | Checksum of the file read. |
SOURCE_RELEASE_DATE | DATE | Date of the read. |
IMPORTED_AT | TIMESTAMP_NTZ | When Civly imported the row. |
FEDERAL_BUYING_SIGNALS.SUBAWARDSOne row per reported federal subcontract or subgrant, including revised reports, from USASpending.gov. 54 columns. The free trial returns fiscal 2016 only. PRIME_AWARDEE_UEI and SUBAWARDEE_UEI identify the two recipients.
| Column | Type | Description |
|---|---|---|
PRIME_AWARD_UNIQUE_KEY | VARCHAR | USASpending's key for the prime award this subaward sits under. |
PRIME_AWARD_PIID | VARCHAR | The prime contract's award number (PIID). Empty for grants. |
PRIME_AWARD_NAICS_CODE | VARCHAR | Industry code (NAICS) on the prime award. |
PRIME_AWARD_NAICS_DESCRIPTION | VARCHAR | The prime award's industry code in words. |
PRIME_AWARD_FAIN | VARCHAR | The prime grant's award number (FAIN). Empty for contracts. |
PRIME_AWARD_CFDA_NUMBERS_AND_TITLES | VARCHAR | Federal assistance program numbers and titles on the prime grant. |
PRIME_AWARD_AMOUNT | NUMBER | Total amount of the prime award, dollars. |
PRIME_AWARD_AWARDING_AGENCY_CODE | VARCHAR | Code of the agency that awarded the prime award. |
PRIME_AWARD_AWARDING_AGENCY_NAME | VARCHAR | Agency that awarded the prime award. |
PRIME_AWARD_AWARDING_SUB_AGENCY_CODE | VARCHAR | Code of the awarding sub-agency or component. |
PRIME_AWARD_AWARDING_SUB_AGENCY_NAME | VARCHAR | Awarding sub-agency or component. |
PRIME_AWARD_FUNDING_AGENCY_CODE | VARCHAR | Code of the agency that funded the prime award. |
PRIME_AWARD_FUNDING_AGENCY_NAME | VARCHAR | Agency that funded the prime award. |
PRIME_AWARDEE_UEI | VARCHAR | The prime recipient's Unique Entity ID (SAM). |
PRIME_AWARDEE_DUNS | VARCHAR | The prime recipient's legacy DUNS number, as reported. |
PRIME_AWARDEE_NAME | VARCHAR | Prime recipient name. |
PRIME_AWARDEE_DBA_NAME | VARCHAR | Prime recipient's doing-business-as name. |
PRIME_AWARDEE_PARENT_UEI | VARCHAR | UEI of the prime recipient's parent company. |
PRIME_AWARDEE_PARENT_NAME | VARCHAR | Prime recipient's parent company. |
PRIME_AWARDEE_STATE_CODE | VARCHAR | Prime recipient's state. |
PRIME_AWARD_BASE_TRANSACTION_DESCRIPTION | VARCHAR | The prime award's description, as published. |
SUBAWARD_TYPE | VARCHAR | sub-contract or sub-grant, as reported. |
SUBAWARD_SAM_REPORT_ID | VARCHAR | The subaward report's id in SAM/FSRS. Re-reports share the subaward; IS_LATEST_REPORT marks the newest. |
SUBAWARD_NUMBER | VARCHAR | The prime recipient's own number for this subaward. |
SUBAWARD_AMOUNT | NUMBER | Subaward amount, dollars. Rows with AMOUNT_SUSPECT true carry amounts that fail Civly's sanity checks. |
SUBAWARD_ACTION_DATE | DATE | Date the subaward was signed or last changed. |
SUBAWARD_ACTION_DATE_FISCAL_YEAR | NUMBER | Federal fiscal year of the action date. |
SUBAWARDEE_UEI | VARCHAR | The subcontractor's or subrecipient's Unique Entity ID (SAM). |
SUBAWARDEE_DUNS | VARCHAR | The subrecipient's legacy DUNS number, as reported. |
SUBAWARDEE_NAME | VARCHAR | Subcontractor or subrecipient name. |
SUBAWARDEE_DBA_NAME | VARCHAR | Subrecipient's doing-business-as name. |
SUBAWARDEE_PARENT_UEI | VARCHAR | UEI of the subrecipient's parent company. |
SUBAWARDEE_PARENT_NAME | VARCHAR | Subrecipient's parent company. |
SUBAWARDEE_ADDRESS_LINE_1 | VARCHAR | Subrecipient street address, as reported. |
SUBAWARDEE_CITY_NAME | VARCHAR | Subrecipient city. |
SUBAWARDEE_STATE_CODE | VARCHAR | Subrecipient state. |
SUBAWARDEE_ZIP_CODE | VARCHAR | Subrecipient ZIP code. |
SUBAWARDEE_COUNTRY_CODE | VARCHAR | Subrecipient country code. |
SUBAWARD_PRIMARY_PLACE_OF_PERFORMANCE_CITY_NAME | VARCHAR | City where the subaward work is mainly performed. |
SUBAWARD_PRIMARY_PLACE_OF_PERFORMANCE_STATE_CODE | VARCHAR | State where the subaward work is mainly performed. |
SUBAWARD_DESCRIPTION | VARCHAR | What the subaward is for, as reported. |
USASPENDING_PERMALINK | VARCHAR | Link to the prime award on USASpending.gov. |
SUBAWARD_SAM_REPORT_LAST_MODIFIED_DATE | TIMESTAMP_NTZ | When this subaward report was last changed in SAM/FSRS. |
SUBAWARDEE_BUSINESS_TYPES | VARCHAR | The subrecipient's SAM business-type flags, as published. |
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_1_NAME | VARCHAR | Name of highly compensated officer 1, published under the federal executive-compensation disclosure. |
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_2_NAME | VARCHAR | Name of highly compensated officer 2, published under the federal executive-compensation disclosure. |
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_3_NAME | VARCHAR | Name of highly compensated officer 3, published under the federal executive-compensation disclosure. |
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_4_NAME | VARCHAR | Name of highly compensated officer 4, published under the federal executive-compensation disclosure. |
SUBAWARDEE_HIGHLY_COMPENSATED_OFFICER_5_NAME | VARCHAR | Name of highly compensated officer 5, published under the federal executive-compensation disclosure. |
KIND | VARCHAR | Civly classification: subcontract or subgrant. |
FISCAL_YEAR | NUMBER | Federal fiscal year of the file this row ships in. The trial returns 2016 only. |
IS_LATEST_REPORT | BOOLEAN | Civly-derived: true on the newest report of a subaward. Amounts should count latest reports only. |
AMOUNT_SUSPECT | BOOLEAN | Civly-derived: true when the published amount fails sanity checks (see AMOUNT_SUSPECT_REASON). |
AMOUNT_SUSPECT_REASON | VARCHAR | Why Civly flagged the amount, when AMOUNT_SUSPECT is true. |
STATE_CONTRACT_AWARDSOne row per contract, purchase order or award from seven sources in the District of Columbia and five states, mapped by Civly into one set of columns. A column a source does not publish is empty. Only current rows ship. 29 columns. The free trial returns the Delaware, Nevada and Louisiana rows.
| Column | Type | Meaning |
|---|---|---|
ID | NUMBER | Civly row id. |
STATE | TEXT | State or district the source covers: DC, DE, VA, NM, NV or LA. |
SOURCE | TEXT | Civly source key: dc_contracts, dc_purchase_orders, de_contracts, va_eva, nm_sunshine_purchases, nv_nevadaepro_contracts or la_checkbook_contracts. The trial returns de_contracts, nv_nevadaepro_contracts and la_checkbook_contracts. |
SOURCE_DATASET_ID | TEXT | The source’s own dataset or file id. |
IS_CURRENT | BOOLEAN | Row is in the source’s latest file. Only current rows ship. |
RECIPIENT_NAME | TEXT | Vendor or recipient as the source publishes it. |
NORM_RECIPIENT_NAME | TEXT | Civly-normalized vendor name for matching. |
RECIPIENT_CITY | TEXT | Vendor city, where published. |
RECIPIENT_STATE | TEXT | Vendor state, where published. |
RECIPIENT_ZIP | TEXT | Vendor ZIP code, where published. |
RECIPIENT_ADDRESS | TEXT | Vendor street address, where published. |
AWARDING_AGENCY | TEXT | Agency that made the award. |
AWARDING_DEPT | TEXT | Department or division, where published. |
AWARDING_AGENCY_CODE | TEXT | Agency code, where published. |
AWARD_ID | TEXT | Contract, purchase order or award number as published. |
AWARD_DESCRIPTION | TEXT | Description of the goods or services, as published. |
AWARD_TYPE | TEXT | Award or procurement type, where published. |
AMOUNT | NUMBER | Dollar amount as published. See AMOUNT_KIND: sources publish contract values, purchase order totals or payments. |
AMOUNT_KIND | TEXT | What AMOUNT measures for this source: award_max, the contract value (District of Columbia contracts, Louisiana); po_total, the purchase order amount (District of Columbia purchase orders, Virginia, New Mexico); or spent_to_date, spending under the contract so far (Delaware, Nevada). |
AWARD_DATE | DATE | Award or order date. |
START_DATE | DATE | Contract start date, where published. |
END_DATE | DATE | Contract end date, where published. |
FISCAL_YEAR | NUMBER | Fiscal year, where published. |
CATEGORY_CODE | TEXT | Commodity or category code, where published. |
CATEGORY_DESC | TEXT | Commodity or category description. |
CATEGORY_SYSTEM | TEXT | Code system of CATEGORY_CODE, for example NIGP or UNSPSC. |
NAICS_CODE | TEXT | NAICS industry code, where published. |
CREATED_AT | TIMESTAMP_NTZ | When Civly first stored the row. |
UPDATED_AT | TIMESTAMP_NTZ | When Civly last updated the row. |
NYC_DOING_BUSINESS_ORGANIZATIONSOne row per organization New York City lists as doing business with it, from NYC Doing Business (Mayor’s Office of Contract Services). The city publishes no organization id, so people join to organizations on ORGANIZATION_NAME only. 10 columns. This table returns no rows during the free trial.
| Column | Type | Meaning |
|---|---|---|
SOURCE_ROW_NUMBER | NUMBER | Position of the row in the city’s file. |
ORGANIZATION_NAME | TEXT | Organization doing business with New York City. |
OWNERSHIP_STRUCTURE_CODE | TEXT | Ownership structure code as the city publishes it. |
ORGANIZATION_PHONE | TEXT | Organization phone number as published. |
SOURCE_ROW_ID | TEXT | The city’s row id. |
DOING_BUSINESS_START_DATE_AS_PUBLISHED | TEXT | Start date exactly as the city publishes it. |
DOING_BUSINESS_START_DATE | DATE | Start date read as a date (two-digit years read as 20YY). |
SOURCE_URL | TEXT | Address of the city’s file. |
SOURCE_RELEASE_DATE | DATE | Release date of the city’s file, when given. |
IMPORTED_AT | TIMESTAMP_NTZ | When Civly imported the row. |
NYC_DOING_BUSINESS_PEOPLEPrincipals of organizations doing business with New York City, from NYC Doing Business (Mayor’s Office of Contract Services). Names and roles only. Join to NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME. 16 columns. This table returns no rows during the free trial.
| Column | Type | Meaning |
|---|---|---|
SOURCE_ROW_NUMBER | NUMBER | Position of the row in the city’s file. |
MOCS_PEOPLE_ID | TEXT | The Mayor’s Office of Contract Services id for the person. |
ORGANIZATION_NAME | TEXT | Organization the person is a principal of. |
PERSON_FIRST_NAME | TEXT | First name. |
PERSON_MIDDLE_NAME | TEXT | Middle name. |
PERSON_LAST_NAME | TEXT | Last name. |
PERSON_NAME_SUFFIX | TEXT | Name suffix. |
RELATIONSHIP_TYPE_CODE | TEXT | The person’s role at the organization, as coded by the city. |
SOURCE_ROW_ID | TEXT | The city’s row id. |
DOING_BUSINESS_START_DATE_AS_PUBLISHED | TEXT | Start date exactly as the city publishes it. |
DOING_BUSINESS_START_DATE | DATE | Start date read as a date. |
DOING_BUSINESS_END_DATE_AS_PUBLISHED | TEXT | End date exactly as the city publishes it. |
DOING_BUSINESS_END_DATE | DATE | End date read as a date. |
SOURCE_URL | TEXT | Address of the city’s file. |
SOURCE_RELEASE_DATE | DATE | Release date of the city’s file, when given. |
IMPORTED_AT | TIMESTAMP_NTZ | When Civly imported the row. |
Forecasts and labor rates share no key. NORM_INCUMBENT_NAME in FORECASTS and NORM_VENDOR_NAME in LABOR_RATES are normalized the same way, so a forecast’s incumbent can be matched to that company’s ceiling rates. A forecast that lists several incumbents joins them as a; b, and those rows match only after you split the value. Subawards identify recipients by UEI and legacy DUNS. The forecast and labor-rate tables have no UEI column, so matching a recipient to them requires checking company names or an outside identifier mapping. STATE_CONTRACT_AWARDS and the two NYC Doing Business tables share no id with the federal tables or with each other. Match them by name, using NORM_RECIPIENT_NAME on the state contract side. NYC_DOING_BUSINESS_PEOPLE joins NYC_DOING_BUSINESS_ORGANIZATIONS on ORGANIZATION_NAME only, because the city publishes no organization id.
After installing, set your worksheet’s database selector to the installed database and these run as written.
-- Forecasts listed now with an award planned in the next 12 months, largest bands first SELECT agency, title, naics_code, set_aside, estimated_value_range, incumbent_name, planned_award_window_start, planned_award_window_end FROM FEDERAL_BUYING_SIGNALS.FORECASTS WHERE listed_in_latest_feed AND planned_award_window_start <= DATEADD(month, 12, CURRENT_DATE) AND planned_award_window_end >= CURRENT_DATE ORDER BY estimated_value_min_usd DESC NULLS LAST LIMIT 50; -- Recompetes listed now, by industry code SELECT naics_code, naics_description, COUNT(*) AS recompetes FROM FEDERAL_BUYING_SIGNALS.FORECASTS WHERE listed_in_latest_feed AND requirement_type = 'recompete' GROUP BY naics_code, naics_description ORDER BY recompetes DESC LIMIT 20; -- Forecasts that left the feeds in the last 30 days SELECT source, agency, title, last_seen_date, solicitation_url FROM FEDERAL_BUYING_SIGNALS.FORECASTS WHERE NOT listed_in_latest_feed AND last_seen_date >= DATEADD(day, -30, CURRENT_DATE) ORDER BY last_seen_date DESC; -- Ceiling rates for one kind of job, by business size SELECT business_size, COUNT(*) AS rates, MEDIAN(current_price) AS median_rate, APPROX_PERCENTILE(current_price, 0.9) AS rate_90th_percentile FROM FEDERAL_BUYING_SIGNALS.LABOR_RATES WHERE category ILIKE '%facilities%' AND labor_category ILIKE '%project manager%' GROUP BY business_size; -- Recompetes whose incumbent also holds GSA schedule rates SELECT f.agency, f.title, f.incumbent_name, f.planned_award_window_start, COUNT(r.rate_id) AS incumbent_rates, MEDIAN(r.current_price) AS median_ceiling_rate FROM FEDERAL_BUYING_SIGNALS.FORECASTS f JOIN FEDERAL_BUYING_SIGNALS.LABOR_RATES r ON r.norm_vendor_name = f.norm_incumbent_name WHERE f.listed_in_latest_feed AND f.requirement_type = 'recompete' GROUP BY f.agency, f.title, f.incumbent_name, f.planned_award_window_start ORDER BY incumbent_rates DESC LIMIT 25; -- Subaward dollars by prime recipient, newest reports with usable amounts only SELECT PRIME_AWARDEE_UEI, PRIME_AWARDEE_NAME, COUNT(*) AS SUBAWARD_REPORTS, SUM(SUBAWARD_AMOUNT) AS REPORTED_SUBAWARD_USD FROM FEDERAL_BUYING_SIGNALS.SUBAWARDS WHERE IS_LATEST_REPORT = TRUE AND AMOUNT_SUSPECT = FALSE GROUP BY PRIME_AWARDEE_UEI, PRIME_AWARDEE_NAME ORDER BY REPORTED_SUBAWARD_USD DESC NULLS LAST LIMIT 25; -- Inspect the reasons amounts were flagged before using them SELECT AMOUNT_SUSPECT_REASON, COUNT(*) AS REPORTS FROM FEDERAL_BUYING_SIGNALS.SUBAWARDS WHERE IS_LATEST_REPORT = TRUE AND AMOUNT_SUSPECT = TRUE GROUP BY AMOUNT_SUSPECT_REASON ORDER BY REPORTS DESC;
Sources: the DHS Acquisition Planning Forecast System (apfs-cloud.dhs.gov), the GSA Acquisition Gateway forecast tool (acquisitiongateway.gov/forecast) and GSA’s CALC+ ceiling rates (buy.gsa.gov/pricing). USASpending.gov supplies the federal subcontract and subgrant reports. These are U.S. government publications, read from their public pages without signing in. Other agencies publish forecasts only on their own sites or in spreadsheets, and those are not included.
Forecasts exclude named agency contacts. The contact and small-business contact names, email addresses and phone numbers the agencies publish are not loaded. Email addresses typed into descriptions, notes and incumbent names are replaced with [email removed].
State and city contract awards come from seven sources. District of Columbia contracts and purchase orders come from PASS, the District’s procurement system, and are credited to the Office of Contracting and Procurement, District of Columbia, under the Creative Commons Attribution 4.0 license (CC BY 4.0). Virginia eVA procurement data is credited to the Virginia Department of General Services and used under the Open Data Commons Attribution License. Delaware contracts come from data.delaware.gov, which Delaware makes available on an “as is” basis. The New Mexico Sunshine Portal (ssp.nm.gov), Nevada ePro (nevadaepro.com) and Louisiana Checkbook (checkbook.la.gov) supply the other three. Civly has changed the data: it maps every source into one set of columns, and where a source lists one contract or order on several lines, it combines them into one row. Coverage is limited to these seven sources. Other states are not included yet.
The two NYC Doing Business tables come from NYC Open Data and are credited to the Mayor’s Office of Contract Services, NYC Doing Business. Civly’s tables are a derived product. Civly reads the city’s dates as dates, and the city’s own text is kept in the _AS_PUBLISHED columns. SOURCE_RELEASE_DATE gives the version of the city’s file each row came from. The city’s table of campaign contributions matched to these organizations and people is not included. NYC.gov’s terms of use say that NYC.gov and all materials on it are distributed “as is” and “as available.”
Civly’s own columns: REQUIREMENT_TYPE, ESTIMATED_VALUE_MIN_USD, ESTIMATED_VALUE_MAX_USD, PLANNED_AWARD_WINDOW_START, PLANNED_AWARD_WINDOW_END, NORM_INCUMBENT_NAME, NORM_VENDOR_NAME, FIRST_SEEN_DATE, LAST_SEEN_DATE and LISTED_IN_LATEST_FEED, plus subaward columns KIND, FISCAL_YEAR, IS_LATEST_REPORT, AMOUNT_SUSPECT and AMOUNT_SUSPECT_REASON, state contract columns NORM_RECIPIENT_NAME, AMOUNT_KIND and IS_CURRENT, and the NYC Doing Business columns DOING_BUSINESS_START_DATE and DOING_BUSINESS_END_DATE. Everything else is as the agencies publish it, apart from the combined state contract rows described above. This product is not endorsed by DHS, GSA, the District of Columbia, the states of Delaware, Virginia, New Mexico, Nevada or Louisiana, the City of New York, or any other government agency.
Permitted use: not for employment, tenant, credit, insurance or licensing decisions about a person.
For coverage or access questions: matthew@civly.ai