Safety Software Quality Assurance
Draft 3/31/2006
Suggested lines of inquiry and
review approach
Performance Objective 1: Contractor Program
Documentation:
While this performance objective is focused on the
Contractor, there are instances where DOE may be the performer
of the work. Where DOE is the performer the contractor
requirements as stated herein apply to the DOE organization
doing the work.
1.1 Safety
Software Inventory: An inventory of safety
software is identified, documented, and maintained.
Approach:
- Determine the existence of a safety software inventory
list. This maybe evidence by an electronic or hardcopy data
set. The inventory list may be a subset of a larger software
inventory list.
- Ensure that the safety software can uniquely be defined.
- Use sampling methods to determine the accuracy and thus
maintenance of the inventory list.
Lines of Inquiry:
- Does a list of safety software, as defined by DOE O
414.1C, documented?
- Is each item on the safety software uniquely
identifiable?
- Is the inventory list current and accurate?
1.2
Safety Software Graded Approach: Establish grading
levels for safety software. Document those grading levels in
the QAP. [Suggested rewrite] Grading levels for safety
software are established and documented in the QAP.
Approach:
- Determine the existence of grading levels for safety
software.
- Review the grading levels for consistency and
completeness with the graded approach as defined in 10 CFR
830 and DOE O 414.1C.
- Determine if the document(s) containing the safety
software grading levels is approved by DOE.
Lines of Inquiry:
- Are the grading levels for safety software documented?
- Are these grading levels consistent and complete as
defined by the graded approach in 10 CFR 830 and DOE O
414.1C?
- Has the document containing the grading levels for
safety software been approved by DOE?
1.3
Safety Software Quality Assurance Consensus Standard:
ASME NQA 1-2000, Quality Assurance Requirements for Nuclear
Facility Applications, or other national or international
consensus standards that provide an equivalent level of
quality assurance requirements as ASME NQA 1 2000, are
specified by the user and approved by DOE.
Approach:
- Determine the consensus standard(s) specified for safety
software quality assurance use. If the standard(s) specified
is not ASME NQA-1-2000, review the documentation to
establish equivalence of the specified standard(s) to ASME
NQA-1-2000.
- Determine if the specified standard(s) for safety
software quality assurance is approved by DOE.
Lines of Inquiry:
- Has a consensus standard been specified for safety
software quality assurance use?
- Has the specified consensus standard(s) been approved by
DOE for safety software quality assurance?
- Is this safety software quality assurance standard, ASME
NQA-1-2000?
- If the specified standard(s) is not ASME NQA-1-2000, has
an equivalency document been developed?
- If an equivalency document has been developed, does it
prove the specified standard(s) provides an equivalent level
of software quality assurance as ASME NQA-1-2000 in the
following work activities?
- Software project management and quality planning.
- Software risk management.
- Software configuration management.
- Procurement and supplier management.
- Software requirements identification and management.
- Software design and implementation.
- Software safety.
- Verification and validation.
- Problem reporting and corrective action.
- Training of personnel in the design, development, use,
and evaluation of safety software
Performance Objective 2: Contractor Program
Implementation:
Work processes involving safety software must be developed
and implemented using the DOE approved national or
international consensus standards (as per the criteria in
Section 1.3 above) and must include the following
elements.
2.1
Facility Design Authority Involvement: Facility design
authority is involved in the identification of software
requirements specification, acquisition, design, development,
verification and validation (including inspection and
testing), configuration management, maintenance, and
retirement.
Approach:
- Review safety software development and acquisition
documents such as safety software requirements, procurement
or acquisition contracts and other documents, software
development plans and documents, verification and validation
documents, software configuration management documents,
software maintenance documents, and software retirement
plans for facility deign authority involvement in the
document reviews and approvals.
- Interview facility design authority personnel and safety
software development and quality assurance staff for the
level of involvement of the facility design authority staff.
Lines of Inquiry:
- Is the facility design authority on the list of
reviewers and/or approvers of the safety software
development documents or their equivalent that are listed
below:
- safety software requirements?
- safety software development plans?
- safety software verification and validation plans?
- safety software configuration management plans?
- safety software test plans?
- Is the facility design authority on the list of
reviewers and/or approvers of the safety software
procurement or acquisition contracts?
- Does the facility design authority have a direct
communication line with the safety software development
2.2
Select and Implement Work Activities: Using DOE
approved grading levels (as per the criteria in Section 1.2
above) and ASME NQA-1-2000, Quality Assurance Requirements for
Nuclear Facility Applications, or other DOE approved national
or international consensus standards that provide an
equivalent level of quality assurance requirements as ASME NQA
1 2000, applicable SQA work activities are selected and
implemented from the following list to ensure that safety
software performs its intended functions.
Approach:
- Review software or quality assurance plans and
documents, to determine if the 10 work activities have been
evaluated to determine their applicability and requirement
for full or graded implementation. The applicability of a
work activity may be determined by the software type such as
custom or acquired. A matrix using the approved grading
levels, the software type and the 10 work activities may
provide evidence that the work activities have been
evaluated.
- Use sampling methods to determine if the work activities
identified through the work activity evaluation process have
been implemented. This determination is associated with the
assessment of the 10 work activities that are sub-elements
to this Performance Objective.
Lines of Inquiry:
- Has a classification/category such as software type to
determine appropriateness for applying the 10 work
activities been defined?
- Has each of the 10 work activities been evaluated to
determine their applicability under the above mentioned
classification/category?
- Does the applicability (i.e., selection) address the
approved graded approach?
- For each of the 10 work activities, has the selected
work activities been implemented?
2.3
Software Project Management and Quality Planning:
Software project management and quality planning depicts
the organizational structure that supports the software
life-cycle stages and deliverables, and influences and
controls the quality of the software.
Approach:
- Confirm the existence of project management and QA
planning work activity. This may be present in software
project management and/or SQA plans that exist either as a
stand alone document or embedded in other documents and
related procedures. The software project management and
software quality planning should identify and/or define the
following:
- software project schedule;
- software project scope;
- software engineering activities, including software
requirements and design;
- software V&V activities, including reviews and
test;
- SCM activities;
- software risk management approach;
- software safety analysis and planning;
- supplier control;
- user and software staff training,
- standards, practices, conventions, and metrics;
- records and document collection, maintenance, and
retention; and
- problem reporting and corrective action methods.
- Many of the items listed above may be detailed in other
documents, for instance software V&V may be detailed in
a software V&V plan or in software test plans. It should
be noted that this work activity addresses the existence
that these items are identified and described. Associated
work activities, such as software V&V address the
quality of the software V&V work activity being
performed as it relates to the grading level.
- Determine whether the documents containing the software
project management and quality plan are controlled under
configuration change control and document control process,
and are maintained until the software is retired. This may
overlap with the SCM work activity.
- Verify that the software project management and quality
plan is reviewed and updated, as necessary, for completeness
and consistency. This may overlap with the software V&V
work activity.
Lines of Inquiry:
- Are the software specific activities and tasks
described, identified and documented?
- Are these activities and tasks sufficient to properly
manage and control the software project and produce the
required level of quality?
- Do these plans identify the organizational structure
associated with the project management and quality planning?
- Are these plans initiated early and maintained
throughout the software development life-cycle?
- Are these plans reviewed, approved and controlled?
- Do these activities and tasks include the following:
- software project schedule?
- software project scope?
- software engineering activities, including software
requirements and design?
- software V&V activities, including reviews and
test?
- SCM activities?
- software risk management approach?
- software safety analysis and planning?
- supplier control?
- user and software staff training?
- standards, practices, conventions, and metrics?
- records and document collection, maintenance, and
retention?
- problem reporting and corrective action methods?
2.4 Software
Risk Management: Software risk management utilizes a
proactive and disciplined approach to assess and control
software risks.
Approach:
- Determine the existence of software risk management
planning. This may be evident in a standalone document or
embedded in another document. As applicable, ensure that the
risk management planning specifies the following:
- scope of the risk management activities;
- risk management policies and process (for both technical
and managerial) under which risk management is to be
performed are defined;
- identification of the technical and managerial risks and
likelihood and potential safety consequences;
- establishment of risk thresholds for the safety software
application;
- risk avoidance, mitigation, or transfer options; and
- management techniques to address risks throughout
project life-cycle, including tracking, decision, and
feedback points.
Lines of Inquiry:
- Have the risks associated with the successful completion
of the software development or procurement been identified
and documented?
- Do these risks include risks associated with costs,
resource availability, schedule, and technical aspects?
- Have risk thresholds been identified and applied?
- Are the risks evaluated for impact and probability of
occurrence initially and periodically through the software
life-cycle?
- Are the risks prioritized and tracked through the
software life-cycle?
- Are actions taken to mitigate the risks using avoidance,
risk reduction, and/or transfer of risks approaches?
2.5
Software Configuration Management: Software
configuration is defined, maintained, and controlled until the
software is retired.
Approach:
- Review appropriate documents, such as applicable
procedures related to safety software change control to
determine if an SCM process exists and is effective. This
determination is made based on the following actions.
- Verify the existence of documented processes to control,
uniquely identify, describe, and document the configuration
of each version or update of safety software and its related
documentation. This documented evidence may be in either SCM
plan or embedded in another software or system level
document.
- Verify that a configuration baseline is defined and that
it is being adequately controlled. This baseline should
include operating system components, any associated runtime
libraries, acquired software executables, custom-developed
source code files, users' documentation, the appropriate
documents containing software requirements, software design,
software V&V procedures, test plans and procedures, and
any software development and quality planning documents.
- Verify a baseline labeling system has been created that
uniquely identifies each configuration item, identifies
changes to configuration items by revision, and provides the
ability to uniquely identify each configuration.
- Review procedures governing change management for
installing new versions of the software components,
including new releases of acquired software.
- Review software change packages and work packages to
ensure that (1) possible impacts of software modifications
are evaluated before changes are made, (2) various software
system products are examined for consistency and revised as
necessary after changes are made and updated, (3) software
is tested according to established standards after changes
have been made, (4) changes are evaluated and approved for
release by the responsible organization, and (5) software
validation is performed as necessary to ensure that the
change does not adversely affect the performance of the
software.
- Verify by sampling that documentation affected by
software changes accurately reflects all safety-related
changes that have been made to the software.
- Interview a sample of cognizant line, engineering, and
QA managers, and other personnel to verify their
understanding of the change control process and commitment
to manage changes affecting design, safety basis, and
software changes in a formal, disciplined, and auditable
manner.
- For custom developed safety software, verify audits or
reviews, such as functional configuration audit or physical
configuration audit, have been performed.
Lines of Inquiry:
- Are the methods used to control, uniquely identify,
describe, and document the configuration of each version or
update of software and its related documentation documented?
- Is a configuration baseline defined and adequately
controlled?
- Does this baseline include operating system components,
any associated runtime libraries, acquired software
executables, custom-developed source code files, users'
documentation, the appropriate documents containing software
requirements, software design, software V&V procedures,
test plans and procedures, and all software development and
quality planning documents?
- Has a baseline labeling system been implemented that
addresses the following:
- Unique identification of each configuration item?
- Changes to configuration items by revision?
- Is the baseline labeling system used throughout the life
of the software development and operation?
- Are proposed changes to the software documented,
evaluated, and approved?
- Is software baselined prior to approval for use?
- Are only approved changes made to the baselined
software?
- Are software verification activities performed for the
change to baselined software?
- For custom developed safety software, have audits or
reviews, such as functional configuration audit or physical
configuration audit, been performed?
2.6
Procurement and Supplier Management: Acquired safety
software, either commercial off-the-shelf (COTS) software or
custom-developed for DOE, meets the appropriate level of QA
based on risk, safety, facility life-cycle, complexity, and
project quality requirements.
Approach:
- Suppliers of acquired software are evaluated to ensure
that the safety software is developed under an appropriate
QA program and satisfies the specific requirements. The
assessment of software procurement process should include
the following.
- Determine the existence of safety software technical and
QA requirements. These requirements may be embedded in the
DOE contractors' or subcontractors' procurement document,
software or system design description, or SQA plan. If not
documented in the procurement contract, ensure that the
supplier has received such technical and QA requirements.
This verification may overlap with the Software Requirements
Management work activity.
- Verify that the suppliers' QA program has been reviewed
and meets or exceeds the procurement specification
requirements. The supplier may review the supplier's QA
program through supplier assessment, supplier self
declaration, third-party certification, or other similar
methods.
- Review evidence that the acquired software was evaluated
for the appropriate level of quality. This evidence may be
included in the test results, a test summary, supplier site
visit reports or supplier QA program assessment reports.
This review may overlap with the V&V work activity.
- Review procurement or other documents between the
supplier and purchaser for a documented process to report
software defects from the supplier to the purchaser and the
purchaser to the supplier. This review may overlap with the
Problem Reporting and Corrective Action work activity.
Lines of Inquiry:
- Does the procurement and supplier documentation include
both the technical and quality requirements including the
following categories of software requirements:
- Functionality?
- Safety?
- Security?
- Performance?
- Quality?
- Does the procurement and supplier documentation include
all documents to be provided to the customer?
- Do the procurement and supplier documents include
requirements for or the procedures for supplier notification
of defects, new releases and other issues?
- Do the procurement and supplier documents include
requirements for or the procedures for users to report
defects and requests for assistance?
- Has the delivered product been assessed or otherwise
validated to ensure requirements have been met? This
evidence may be included in the test results, a test
summary, supplier site visit reports or supplier QA program
assessment reports.
- Has the suppliers' QA program has been reviewed to
ensure it meets or exceeds the procurement specification
requirements? This may include review the supplier's QA
program through supplier assessment, supplier self
declaration, third-party certification, or other similar
methods.
2.7
Software Requirements Identification and Management:
Safety software functions, requirements, and their bases are
defined, documented and managed throughout the safety software
life-cycle.
Approach:
- Review appropriate safety basis documents, such as DSAs,
safety analysis reports, TSRs, procurement specifications
and any system documentation to determine if the safety
software requirements document is consistent with the safety
system design and safety basis. The software requirements
may exist either as a standalone document, such as a
software requirements specification, or embedded in other
system or software level documents.
- Determine whether the following types of requirements
are addressed as appropriate.
- Verify that the software requirements address
functionality, performance, security, safety design
inputs, design constraints, installation considerations,
operating systems (if applicable), and external interfaces
necessary to design the software exist and are documented.
- If access to the system by only authorized users is a
requirement, verify that use of software is controlled so
that only personnel on authorized user lists apply or
maintain safety software.
- Verify that the software requirements are correct,
unambiguous, complete, consistent, verifiable, modifiable
and traceable as appropriate.
- Verify that acceptance criteria are established in the
software requirements for each of the identified
requirements. Such criteria should be used for V&V
planning and performance as defined in each related
life-cycle phase.
- Verify that the software requirement documents are
controlled under the configuration change control and
document control processes. This may overlap with the SCM
activity.
- Verify that software requirement documents are
reviewed and updated as necessary. This may overlap with
the software V&V work activity.
Lines of Inquiry:
- Are the software requirements defined and documented
throughout the safety software life-cycle?
- Are the software requirements uniquely identified?
- Are the requirements controlled and maintained
throughout the safety software life-cycle to minimize
conflicting requirements and to maintain accuracy?
- Are the software requirements traceable throughout the
software life-cycle?
- Are changes to the software requirements updated in any
and all documents?
- Are the requirements consistent with the safety system
basis?
- Do the software requirements address each type of the
following categories:
- Functional?
- Performance/timing?
- Security, including user access restrictions?
- Interface?
- Safety?
- Are the software requirements complete, correct,
consistent, clear, testable and feasible?
- Can the software requirements be objectively verified
and validated?
2.8
Software Design and Implementation: The safety
software design depicting the logical structure, information
flow, logical processing steps, data structures and interfaces
are defined and documented. The design is properly implemented
in the safety software.
Approach:
- Review the appropriate documents, including design
documents, review records, and source code listings. The
design may be documented in a standalone document or
embedded in other documents.
- The software design description should contain the
following information.
- A description of the major safety components of the
software design as they relate to the software
requirements, and any interactions with non-safety
components.
- A technical description of the software with respect
to control flow, control logic, mathematical model, data
structure and integrity, and interface.
- A description of inputs and outputs including
allowable or prescribed ranges for inputs and outputs.
- A description of error handling strategies and the use
of interrupt protocols.
- The design described in a manner suitable for
translating into computer codes.
- Evidence of reviews of the design and code for the
appropriate grading exists. This may overlap with the
software V&V work activity.
- Evidence of developer testing including any independent
testing for the appropriate grading exists.
Lines of Inquiry:
- Is the safety software design complete and sufficient to
meet the safety software requirements?
- Does the safety software design fully describe the
interfaces with external components or systems?
- Does the safety software design describe how the
software functions internally?
- Does the safety software design describe the control
flow, control logic, mathematical model?
- Does the safety software design describe the inputs and
outputs including allowable or their prescribed ranges?
- Does the safety software design describe the data
structures and provide layouts of those structures?
- Does the safety software describe error handling
strategies and the use of interrupt protocols?
- Has a traceability between safety software requirements
and the design been performed and is documented?
- Have static analysis such as code reviews been performed
on safety software code modules?
- Is the static analysis performed adequate coverage of
critical safety software components?
- Was developer unit testing completed prior to system
level testing?
- Was developer testing, including unit, integration, and
system level testing, planned and documented?
- Does the developer testing include tests to address
functions, code structure and logic, stress and load
testing, software performance, and human factors?
- Have the results of developer testing been analyzed and
documented?
- Where appropriate, have reviews and testing been
performed by persons independent of the activity or code
module being reviewed or tested?
2.9 Software Safety:
The design of the safety software components is developed
to ensure the software modules perform their intended safety
function in a manner consistent with the implementation of the
safety system.
Approach:
- Review hazard analysis documents to ensure that software
component and interface failures are included. This analysis
may be part of a software or system level failure modes and
effects analysis, fault-tree analysis, event-tree analysis
or other similar analysis techniques.
- Review how the identified hazards are resolved. Various
methods are used for hazards resolutions, such as
eliminations, reduction of exposure, and controlling or
minimizing the effects of a hazard.
- Review that the hazard analysis is periodically
reassessed throughout the software life cycle and the
changes incorporated as appropriate.
- For Level A safety software, and optionally for Level B
safety software, sample safety software modules for proof of
design complexity evaluation and isolation of safety
functions from non-safety functions.
- For Level A safety software, and optionally for Level B
where safety software modules defects could impact the safe
operation of the system, evaluate the software design for
the implementation of fault tolerant and/or self-diagnostics
techniques.
Lines of Inquiry:
- Has a hazard analysis of the software at the component
level been performed and documented?
- Did the hazard analysis identify the potential failures,
the consequences of those failures, and the probably of
occurrence associated with those failures?
- Have actions been taken to eliminate or mitigate the
identified failures based upon the consequences of failure
and probability of occurrence?
- Was the hazard analysis periodically reviewed and
reassessed for possible changes in identified hazards or the
addition of new hazards?
- Have the changes to the hazards analysis been
incorporated into the design of the safety software?
- For Level A safety software, are the safety software
components isolated from non-safety software components?
- For Level A safety software, was the complexity of the
software components used in evaluating the software design?
- For Level A safety software, have fault tolerant
techniques been considered in the design?
- For Level A safety software, have fault detection and/or
self diagnostics been considered in the design?
2.10
Verification and Validation (V&V): The V&V
process and related documentation for software are defined and
maintained to ensure, (1), the software correctly performs all
its intended functions; (2), the software does not perform any
adverse unintended function; and (3), the operation of the
software addresses the original purpose, intent, and plan.
Approach:
- Review appropriate documents, such as SQA plans, review
plans, walkthrough records, peer review records, desk check
records, inspection reports, test plans, test cases, test
reports, test results, traceability matrices, system
qualification plans and reports, and supplier qualifications
to determine whether-
- management process exists for performing V&V and
management and independent technical reviews;
- reviews and inspections of the software requirement
specifications, procurement documents, software design, code
modules, test results, training materials, and user
documentation have been performed by staff other than those
who developed the item;
- software design was performed prior to the safety
software being used in operations;
- for software design V&V-
- results of the safety software V&V are documented
and controlled;
- V&V methods include any one or a combination of
design reviews, alternate calculations, and tests
performed during program development; and
- the extent of V&V methods chosen are a function of
(1) the complexity of the software; (2) the degree of
standardization; (3) the similarity with previously proved
software; and (4) the importance to safety; and
- for software test V&V-
- documentation for development, factory or acceptance
testing, installation, and operations testing exists and
is adequate;
- documentation includes test guidelines, test
procedures, test cases including test data, and expected
results;
- results documentation demonstrates successful
completion of all test cases or the resolution of
unsuccessful test cases and proves direct traceability
between the test results and specified software design;
- test V&V activities and their relationship with
the software life-cycle are defined;
- software requirements and system requirements are
satisfied by the execution of integration, system and
acceptance testing;
- acceptable methods for evaluating the software test
case results include (1) analysis without computer
assistance, (2) other validated computer programs, (3)
experiments and test, (4) standard problems with known
solutions, and (5) confirmed published data and
correlations;
- traceability exists from software requirements to
design and testing, and if appropriate, to user
documentation; and
- hardware and software configurations pertaining to the
test V&V are specified.
- Observe or perform configuration management query tasks
to address the lines of inquiry.
Lines of Inquiry:
- Are verification and validation activities performed by
competent staff that is independent of the item being
verified or validated?
- Are the verification and validation activities
integrated with the software lifecycle and performed to
ensure software requirements are correctly specified and
implemented in the design, test documentation and released
software code?
- Do management processes exist for performing each of the
following:
- Verification and validation activities?
- Management reviews?
- Independent technical reviews?
- Do the verification and validation activities include
reviews and/or inspections of the following applicable
items? (Note: these items may be combined or included with
other system and software documentation.)
- Software requirements specification
- Software procurement criteria and documents
- Software design
- Code modules
- User/operator training materials
- Software development processes
- Test results
- Have the software testing activities been planned and
documented?
- Have the software testing plans been placed under
configuration management?
- Do the software test plans include testing for
development, factory or acceptance testing, installation,
and operations tests?
- Do the software development, factory or acceptance
testing, installation, and operations test cases and
procedures include expected results?
- Are the software development, factory or acceptance
testing, installation, and operations test cases,
procedures, and test results documented?
2.11
Problem Reporting and Corrective Action: Methods for
documenting software problem reporting, and corrective action
for safety software errors and failures are established,
maintained, and controlled.
Approach:
Review documents and interview facility staff for the
problem reporting and notification process to determine
whether-
- methods for documenting software problem reporting and
corrective action development that addresses software
errors, failures, and resolutions;
- problems that impact the operation of the software are
promptly reported to affected organizations;
- corrections and changes are evaluated for impact and
approved prior to being implemented;
- corrections and changes are verified for correct
operation and to ensure that no side effects were
introduced;
- preventive measures and corrective actions are provided
to affected organizations in a timely manner; and
- the organizations responsible for problem reporting and
resolution are clearly defined.
Lines of Inquiry:
- Are the practices and procedures for each of the areas
below defined and documented?
- Reporting problems or issues
- Tracking those problems or issues
- Resolving those problems or issues
- Are the above practices and procedures implemented as
defined above?
- Does a process exist for evaluating if the reported
problem or issue is a software defect, error or other
source?
- Are responsibilities for the following activities
identified?
- Reporting issues
- Approving changes
- Implementing corrective actions
- Are the corrective actions implemented effective to
ensure correct operation and no side effects were
introduced?
- Are the defects and errors associated with the safety
software defects and errors correlated with software
elements?
- Has the potential impact of those defect and errors been
evaluated?
- Are the preventative measures and corrective actions
commensurate with the impact of the original defect?
- Have all users of the safety software been notified in a
timely manner of the potential impact of the defects and
errors?
- For acquired safety software, do the procurement
documents include requirements for the supplier to report
problems to the user or purchaser?
- For acquired safety software, do the procurement
documents include requirements and/or procedures for the
purchaser or user to report problems to the supplier?
- Confirm and identify the applicable parts of NQA-1-2000,
or an equivalent consensus standard for the SQA
requirements, have been used for this requirement
2.12
Training of Personnel in the Design, Development, Use, and
Evaluation of Safety Software: Personnel are
trained/qualified and capable of performing assigned work.
Continuing training to personnel to maintain job proficiency
is provided.
Approach:
- Review training records or other documentation and
conduct interviews to confirm a training or indoctrination
program exists for each of the personnel assignments listed
above.
- Verify the training program provides for continuing
education.
- Verify the training program is adequate and appropriate
for the scope, complexity, and importance of the task being
performed.
Lines of Inquiry:
- Does a training or indoctrination program exist for each
of the following personnel assignments?
- safety software analysis
- software development (concept to retirement)
- operations and use
- assessment or evaluation of safety software
- Does the training or indoctrination program provide for
continuing education and training for each of the above
personnel?
- Does the continuing education and training improve the
performance and proficiency for each of the above personnel?
- Is the training or indoctrination program designed
according to the scope, complexity, and importance of the
tasks, education and proficiency of the personnel?
- Confirm and identify the applicable parts of NQA-1-2000,
or an equivalent consensus standard for the SQA
requirements, have been used for this requirement.
- For Level A safety software, are metrics and measured
used to determine the impact of the training or
indoctrination program on personnel performance?
- For Level A safety software, are metrics and measured
used to determine the impact of the training or
indoctrination program on personnel proficiency?
Performance Objective
3: DOE Line Management Oversight Documentation:
Federal personnel have the technical competency to perform
SQA responsibilities: Federal personnel with SQA
responsibilities have technical competency to carry out their
duties. Technical qualification requirements are specified in
technical qualification standards. The process has been
coordinated with the Federal Technical Capability Panel (FTCP)
in accordance with the requirements of DOE M 426.1-1A, Federal
Technical Capability Manual, dated May 18, 2004, and DOE
STD-1172-2003, Safety Software Quality Assurance Functional
Area Qualification Standard, dated December 2003.
Approach:
- Review the technical qualification records to determine
the individual responsible for having the technical
competency for safety software quality assurance.
- Review the qualification process of the individual to
ensure it meets DOE M 426.1-1A.
Lines of Inquiry:
- Has DOE/NNSA identified an individual or individuals
responsible for performing SQA responsibilities?
- Are each of these individuals qualified as per DOE
STD-1172-2003, Safety Software Quality Assurance Functional
Area Qualification Standard, dated December 2003?
- Did this qualification meet the process in accordance
with DOE M 426.1-1A, Federal Technical Capability Manual,
dated May 18, 2004?
- Has a Technical Qualification Program (TQP) approved SQA
Functional Area Qualification (FAQ) card been completed for
each of the individuals responsible for performing SQA
responsibilities?
< BACK TO PREVIOUS PAGE