WO2002041167A2

WO2002041167A2 - Method and apparatus for dynamically testing electrical interconnect

Info

Publication number: WO2002041167A2
Application number: PCT/US2001/050837
Authority: WO
Inventors: Barton Quayle; Stephen P. Sample
Original assignee: Quickturn Design Systems, Inc.
Priority date: 2000-10-23
Filing date: 2001-10-19
Publication date: 2002-05-23
Also published as: WO2002041167A3; AU2002239729A1

Abstract

A hardware emulation system is disclosed which reduces hardware cost by time-multiplexing multiple design signals onto physical logic chip pins and printed circuit board. The reconfigurable logic system of the present invention comprises a plurality of reprogrammable logic devices, and a plurality of reprogrammable interconnect devices. The logic devices and interconnect devices are interconnected together such that multiple design signals share common input/output pins and circuit board traces. A logic analyzer for a hardware emulation system is also disclosed. The logic circuits necessary for executing logic analyzer functions is programmed into the programmable resources in the logic chips of the emulation system. A method for dynamically testing the interconnect between integrated circuits is also disclosed.

Description

METHOD AND APPARATUS FOR DYNAMICALLY TESTING ELECTRICAL INTERCONNECT

1. Field of the Invention

The present invention relates in general to apparatus for verifying electronic circuit designs and more specifically to his invention relates to the design and use of electric interconnect test circuitry. In particular, the present invention relates to the circuitry and test methods used to locate damaged, high impedance or high capacitive paths between interconnected programmable chips.

2. Background of the Invention Hardware emulation systems are devices designed for verifying electronic circuit designs prior to fabrication as chips or printed circuit boards. These systems are typically built from programmable logic chips (logic chips) and programmable interconnect chips (interconnect chips). The term "chip" as used herein refers to integrated circuits. Examples of logic chips include reprogrammable logic circuits such as field- programmable gate arrays ("FPGAs"), which include both off-the-shelf products and custom products. Examples of interconnect chips include reprogrammable FPGAs, multiplexer chips, crosspoint switch chips, and the like. Interconnect chips can be either off-the-shelf products or custom designed.

Prior art emulation systems have generally been designed so that each signal in an electronic circuit design to be emulated is mapped to one or more physical metal lines ("wires") within a logic chip. Signals which must go between logic chips are mapped to one or more physical pins on a logic chip and one or more physical traces on printed circuit boards which contain the logic and interconnect chips.

The one-to-one mapping of design signals to physical pins and traces in prior art emulation systems leads to the requirement that the emulation system contain at least as many logic chip pins and printed circuit board traces as there are design signals to be routed between logic chips. Such an arrangement requires the use of very complex and expensive integrated circuit packages, printed circuit boards and circuit board connectors to construct the emulation system. The high cost of these components, which in turn increases the cost of the hardware logic emulation system, is a factor in limiting the number of designers who can afford, and therefore, benefit from, the advantages provided by hardware emulation systems. Furthermore, integrated circuit fabrication technology is allowing the use of ever decreasing feature sizes. Thus, the logic density of logic chips (i.e., the number of logic gates that can be implemented therein) has increased dramatically. The increase in the number of logic gates that can be implemented or emulated in a single logic chip, however, has not been met with an increase in the number of pins (i.e., leads) available for inputs, outputs, clocks and the like on the chip's package. The number of pins on an integrated circuit package is limited by the available perimeter of the chip. Furthermore, the capability of the wire-bonding assembly equipment used to connect the bonding pads on integrated circuit dice to the pins on the package has increased slowly over time. Thus, there is an increasing mismatch between the amount of logic available on a logic chip and the number of pins available to connect the logic to the outside world. This results in poor average utilization of the logical capacity of the logic chips, which increases the cost of a hardware emulation system necessary for emulation of a given sized electronic circuit design. Time-multiplexing is a technique that has been used for sharing a single physical wire or pin between multiple logical signals in certain types of systems where the cost of each physical connection is very high. Such systems include telecommunication systems. Time-multiplexing, however, has not been commonly used in hardware emulation systems such as those available from Quickturn Design Systems, Inc., Mentor Graphics Corporation, Aptix Corporation, and others because the use of prior art time-multiplexing methods significantly reduced the speed at which the emulated circuit could operate. Furthermore, prior art time-multiplexing techniques makes it difficult to preserve the correct asynchronous behavior of an embedded design in the hardware emulation system. As discussed, one function of hardware emulation systems is to verify the functionality of an integrated circuit. Typically, when a circuit designer or engineer designs an integrated circuit, the design is represented in the form of a "netlist" description of the design. A netlist description (or "netlist", as it is referred to by those of ordinary skill in the art) is a description of the integrated circuit's components and electrical interconnections between the components. The components include all those circuit elements necessary for implementing a logic circuit, such as combinational logic (e.g., gates) and sequential logic (e.g., flip-flops and latches). Prior art emulation systems analyzed the user's circuit netlist prior to implementing the netlist into the hardware emulation system. This analysis included the steps of separating the various circuit paths of the design into clock paths, clock qualifiers and data paths. A method for performing this analysis and separation is disclosed in United States Patent No. 5,475,830 by Chen et al, which is assigned to the same assignee as the present invention. The disclosure of United States Patent No. 5,475,830 is incorporated herein by reference in its entirety. The techniques disclosed in United States Patent No. 5,475,830 have been used in prior art emulation systems such as the System Realizer™ brand hardware emulation system from Quickturn Design Systems, Inc., Mountain View, California. However, the techniques disclosed therein have not been used in combination with any type of time-multiplexing. Other prior art hardware emulation systems such as those available from Virtual Machine Works (now IKOS), ARKOS (now Quickturn Design Systems, Inc. (the assignee of the present application), a Cadence Company) and LBM have attempted to use time- multiplexing of design signals onto a single physical logic chip pin and printed circuit board trace to seek lower hardware cost for a given size of electronic design to be emulated. These prior art emulation systems, however, alter or re-synthesize clock paths in an attempt to maintain correct circuit behavior. This alteration or re-synthesis process works predictably for synchronous designs. However, altering or re-synthesizing the clock paths in an asynchronous design can lead to inaccurate or misleading emulation results. Since most circuit designs have asynchronous clock architectures, the need to alter or re- synthesize the clock paths is a large disadvantage.

In addition, prior art hardware emulation machines using time-multiplexing have suffered from low operating speed. This is a consequence of re-synthesizing the clock paths. In these machines, a number of internal machine cycles are required to emulate one clock cycle of a design. Thus, the effective operating speed for the emulated design is typically many times slower than the maximum clock rate of the emulation system itself. If there are multiple asynchronous clocks in the design to be emulated, the slowdown typically becomes even worse because of the need to evaluate the state of the emulated design between each pair of input clock edges.

Prior art hardware emulation machines using time-multiplexing also require complex software for synchronizing the flow of many design signals over a single physical logic chip pin or printed circuit board trace. Each design signal must be timed so that it has the correct value at the instant it is needed in other parts of the system to compute other design signals. This timing analysis software (also known as scheduling software) adds to the complexity of the emulator and to the time needed to compile a circuit design into the emulator. Furthermore, prior art hardware emulation machines which use time-multiplexing only use a simple form of time-multiplexing which requires minimal hardware but uses a large amount of power (e.g., current), and requires a complex system design.

In addition, as is seen in the prior art, emulation systems are generally comprised of large numbers of integrated circuits having input/output pins connected together. In emulation systems, including the various embodiments of the present invention, these connections are such that every programmable chip input/output pin is physically connected to other programmable chip input/output pins via one of two topologies. The first topology, which can be called "local direct connect", is where the chips being interconnected are located on the same printed circuit board ("PCB") and are connected via PCB traces. The second topology, which can be called "distant connect", is where two chips on different PCBs are connected via separate PCB traces joined by connectors. This specification defines a net as a connection made between different input/output pins via a conductive medium that may have a bi-directional buffer in between.

In emulation systems, most nets are simple point-to-point nets. A point-to-point net is defined as an input/output pin on a first device that is connected to a input/output pin on a second device. Note that there are some situations, however, where there may be more than two pins on a net. As one example, the can be one pin on the first device connected to a pin on second device, a pin on third device, and possibly another pin on a fourth device. Because of the large number of nets (i.e., pin-to-pin interconnections) emulation systems have, emulation systems such as those manufactured by Quickturn Design Systems, Inc. are very complicated physical structures. The PCBs that are used can have over thirty layers. In addition, the connectors used to interconnect boards can have hundreds of pins. Because of the complicated nature of emulation systems, manufacturing defects can arise that cause nets to be shorted, have high resistance, and/or high capacitance. If any one of the nets has such a manufacturing defect, the performance of the emulation system will be degraded, or the emulation system may not work at all. At the same time, it is very difficult to test each and every net for a defect. Thus, there is a need for a hardware emulation system which has very high logical capacity, fast compile times, less complex software, simplified mechanical design and reduced power consumption. There is also a need for a method and apparatus for testing the nets of the emulation system.

SUMMARY OF THE INVENTION A new type of hardware emulation system is disclosed and claimed which reduces

^' hardware cost by time-multiplexing multiple design signals onto physical logic chip pins and printed circuit board traces but which does not have the limitations of low operating speed and poor asynchronous performance. Additional methods to multiplex multiple signals onto a single physical interconnection which are suitable for hardware emulation but do not have the disadvantages of high power and complex system design are also disclosed.

In the preferred embodiment, time-multiplexing is performed on clock qualifier paths (a clock qualifier is any signal which is used to gate a clock signal) and data paths in a design but not on clock paths (a clock path is the path between the clock signal and the clock source from which the clock signal is derived).

The reconfigurable logic system of the present invention comprises a plurality of reprogrammable logic devices, each having internal circuitry which can be reprogrammably configured to provide at least combinatorial logic elements and storage elements. The programmable logic devices also have programmable input/output terminals which can be reprogrammably interconnected to selected ones of functional elements of the logic devices. The reprogrammable logic devices have input demultiplexers and output multiplexers implemented at each input/output, terminal. The input demultiplexers receive a time-multiplexed signal and divide it into one or more internal signals. The output multiplexers combine one or more internal signals onto a single physical interconnection.

The invention also comprises a plurality of reprogrammable interconnect devices, each of which have input/output terminals and internal circuitry which can be reprogrammably configured to provide interconnections between selected input/output terminals. The reprogrammable interconnect devices also have input demultiplexers and output multiplexers implemented at each input/output terminal. The input demultiplexers receive a time-multiplexed input signal and divide it into one or more component signals. The output multiplexers combine one or more component signals onto a second single physical interconnection. The invention also comprises a set of fixed electrical conductors connecting the programmable input/output terminals on the reprogrammable logic devices to the input/output terminals on the reprogrammable interconnect devices.

In another aspect of the present invention, a logic analyzer is integrated into the logic emulation system which provides complete visibility of the design undergoing emulation. The logic analyzer of the present invention is distributed, in that its components are integrated into many of the resources of the emulation system. The logic analyzer of the present invention comprises having at least scan chains programmed into each of the logic chips of the logic boards. The scan chains are comprised of at least one flip-flop. The scan chains are programmably connectable to selected subsets of sequential logic elements of the design undergoing emulation.

The logic analyzer further comprises at least one memory device which is in communication with the scan chain. This memory device stores data from the sequential logic elements of the logic design undergoing emulation. Control circuitry communicates with the logic chips of the emulation system and generates logic analyzer clock signals which clock the scan chains. The control circuitry also generates trigger signals when predetermined combinations of signals occur in the logic chips.

In another aspect of the present invention, a method for dynamically testing interconnections between a first integrated circuit and a second integrated circuit (e.g., the interconnections between a programmable logic chip and a programmable interconnect chip, or the interconnections between two different programmable interconnect chips) is disclosed. The method involves the steps of programming a first cell into the first chip such that the first cell is in electrical communication with a pin on the first chip. The first cell can comprise a first storage element. A second cell is programmed into the second chip such that the second cell is in electrical communication a pin on the second chip. The second cell can comprise a second storage element. A predetermined data value is programmed into the first cell while a predetermined expected data value is programmed into the second cell. The predetermined data value is transmitted from the first chip, through the interconnect, to the second chip. The predetermined data value received by the second chip is compared to the predetermined expected value. An error flag is output if the predetermined data value received by the second chip and the predetermined expected value do not match.

In one embodiment of this method, the first cell comprises a first and a second shift register wherein outputs from the first and second shift register are input to a multiplexer. A driver receives an output from this multiplexer, which controls whether the output from the multiplexer is placed onto the interconnect.

In an embodiment of this invention, the second cell comprises a third and a fourth shift register wherein outputs from the third and fourth shift register are input to a multiplexer, which controls whether the output from the multiplexer is placed onto the interconnect.

In another embodiment of the present invention, the first cell comprises a plurality of registers for storing the predetermined data values. This plurality of registers is in electrical communication with a multiplexer that selects which predetermined data value is placed onto the interconnect. In this embodiment, the second cell comprises a plurality of registers for storing the predetermined expected values This plurality of registers is in electrical communication with a multiplexer that selects which predetermined expected value is compared to the received predetermined data value.

In another aspect of the present invention, an apparatus for testing integrity of interconnections between a first integrated circuit and a second integrated circuit is disclosed. The first integrated circuit comprises a first pin, while the second integrated circuit comprises a second pin. The first and second pin are in electrical communication with each other through an interconnect. The apparatus of this aspect of the invention comprises a first cell in electrical communication with the first pin on the first integrated circuit. The first cell comprises a first pattern match circuit. The first cell stores a predetermined data value. The apparatus of this aspect of the invention also comprises a second cell in electrical communication with the second pin on the second integrated circuit. The second cell comprises a second pattern match circuit. The second cell stores a predetermined expected value. In an embodiment of this aspect of the present invention, the first cell comprises a first shift register and a second shift register. The first shift register comprises a first register and a second register while the second shift register comprises a third register and a fourth register. The first cell comprises a first multiplexer and a first driver. The first register is in electrical communication with the first pattern match circuit while the second register is in electrical communication with the first multiplexer. The third register is in electrical communication with the first pattern match circuit while the fourth register is in electrical communication with the first multiplexer. In this embodiment of the invention, the second cell comprises a third shift register and a fourth shift register. The third shift register comprises a fifth register and a sixth register. The fourth shift register comprises a seventh register and an eighth register. The second cell further comprises a second multiplexer and a second driver. The fifth register is in electrical communication with the second pattern match circuit. The sixth register is in electrical communication with the second multiplexer while the seventh register is in electrical communication with the second pattern match circuit. The eighth register is in electrical communication with the second multiplexer.

In another embodiment of this aspect of the invention, the first cell comprises a plurality of first registers. The plurality of first registers output to a first multiplexer while the first multiplexer outputs to the first pattern match circuit and to a first driver. The first driver outputs the predetermined data value to the first pin on the first integrated circuit. This first pin is supposed to be in electrical communication with the second pin on the second integrated circuit though a interconnect structure. This is the interconnect structure being tested for integrity. In this embodiment, the second cell comprises a plurality of second registers. This plurality of second registers outputs to a second multiplexer while the second multiplexer outputs to a second pattern match circuit. The second pattern match circuit compares the predetermined expected value with the predetermined data value.

The above and other preferred features of the invention, including various novel details of implementation and combination of elements will now be more particularly described with reference to the accompanying drawings and pointed out in the claims. It will be understood that the particular methods and circuits embodying the invention are shown by way of illustration only and not as limitations of the invention. As will be understood by those skilled in the art, the principles and features of this invention may be employed in various and numerous embodiments without departing from the scope of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference is made to the accompanying drawings in which are shown illustrative embodiments of aspects of the invention, from which novel features and advantages will be apparent.

Fig. 1 is a block diagram showing a partial crossbar network incorporating time- multiplexing.

Fig. 2 is a timing drawing showing the signal relationships for two-to-one time- multiplexing. Fig. 3 is a block diagram showing the circuitry necessary in an FPGA to do two-to- one time-multiplexing.

Fig. 4 is a block diagram showing the equivalent circuitry in a multiplexing chip.

Fig. 5 is a timing diagram showing the signal relationships necessary for four-to- one time-multiplexing.

Fig. 6 is a block diagram showing the logic necessary in an FPGA to do four-to- one time-multiplexing.

Fig. 7 is a block diagram showing the equivalent circuitry in a multiplexing chip.

Fig. 8 is a timing diagram showing the signal relationships for a pulse width encoding scheme suitable for a hardware emulation system.

Fig. 9 is a timing diagram showing the signal relationships for a phase encoding scheme suitable for a hardware emulation system.

Fig. 10 is a timing diagram showing the signal relationships for a serial data encoding scheme suitable for a hardware emulation system. Fig. 11 is a block diagram of a logic board of a preferred embodiment of the present invention.

Fig. 12 is a block diagram of the interconnection among the various circuit boards of a preferred embodiment of the present invention.

Fig. 13 is a diagram showing the physical construction of a preferred embodiment of the present invention.

Fig. 14 is a block diagram of the interconnection among the various circuit boards of a version of the presently preferred emulation system that has less logical capacity.

Fig. 15 is a diagram showing the physical construction of the emulation system of Fig. 14 that has one logic board and one input/output board. Fig. 16 is a block diagram of an input/output board and core board.

Fig. 17 is a block diagram of a mux board.

Fig. 18a is a block diagram of an expandable mux board.

Fig. 18b is a block diagram of a presently preferred expandable mux board.

Fig. 19 is a block diagram showing how the user clocks are distributed in a preferred hardware emulation system of the present invention.

Fig. 20 is a block diagram showing the control structure of a preferred hardware emulation system of the present invention.

Fig. 20a is a block diagram of the logic analyzer of a preferred embodiment of the present invention.

Fig. 20b is a block diagram showing the data path for logic analyzer signals of a preferred embodiment of the present invention.

Fig. 20c is a block diagram showing how logic analyzer events are distributed in the logic chips in a preferred embodiment of the present invention. Fig. 20d is a logic diagram showing how probed signals are computed from storage elements and external input values.

Fig. 21 is a flow chart showing how to program a preferred embodiment of the hardware emulation system of the present invention.

Fig. 22 is a flow diagram showing the sequence of steps necessary for the compilation of a software-hardware model created by a behavioral testbench compiler according to a preferred embodiment of the present invention.

Fig. 22a is a block diagram showing an example of a memory circuit that could be generated by the LCM memory generator of a preferred embodiment of the present invention. Fig. 23 is a block diagram of a netlist structure created to represent special connections of the co-simulation logic to a microprocessor event synchronization bus according to a preferred embodiment of the present invention.

Fig. 24a is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the 1/0 pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24b is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the 1/0 pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24c is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24d is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24e is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24f is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24g is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention. Fig. 24h is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24i is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 24j is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pms of a logic chip in a preferred embodiment of the present invention.

Fig. 24k is a schematic diagram of a time-division-multiplexing cell which may be inserted depending on the type of the I/O pins of a logic chip in a preferred embodiment of the present invention.

Fig. 25 is a block diagram of an event detection cell of a preferred embodiment of the present invention.

Fig. 26 is a schematic diagram showing how the outputs of AND trees are time- multiplexed pairwise using special event-multiplexing cells in accordance with an embodiment of the present invention.

Fig. 27 is a block diagram of an event detector download circuit of a preferred embodiment of the present invention. Fig. 28 is a block diagram showing circuitry of an embodiment for performing dynamic testing electrical interconnect.

Fig. 29 is a timing diagram showing the signal relationships necessary to perform dynamic testing of electrical interconnect using the circuitry shown in Fig. 28.

Fig. 30 is a block diagram showing circuitry of another embodiment for performing dynamic testing electrical interconnect.

Fig. 31 is a timing diagram showing the signal relationships necessary to perform dynamic testing of electrical interconnect using the circuitry shown in Fig. 30.

DETAILED DESCRIPTION OF THE DRAWINGS Turning to the figures, the presently preferred apparatus and methods of the present invention will now be described.

Fig. 1 shows a portion of the partial crossbar interconnect for a preferred embodiment of a hardware emulation system of the present invention. Embodiments of a partial crossbar interconnect architecture have been described in the United States Patent Nos. 5,036,473, 5,448,496 and 5,452,231 by Butts et al, which are assigned to the same assignee as the present invention. The disclosure of United States Patent Nos. 5,036,473, 5,448,496 and 5,452,231 are incorporated herein by reference in their entirety. In a partial crossbar interconnect, the input/output pins of each logic chip are divided into proper subsets, using the same division on each logic chip. The pins of each Mux chip (also known as crossbar chips) are connected to the same subset of pins from each logic chip. Thus, crossbar chip "n is connected to subset n of each logic chip's pins. As many crossbar chips are used as there are subsets, and each crossbar chip has as many pins as the number of pins in the subset times the number of logic chips. Each logic chip/crossbar chip pair is interconnected by as many wires, called paths, as there are pins in each subset. The partial crossbar interconnect of Fig. 1 comprises a number of reprogrammable interconnect blocks 12, which in a preferred embodiment are multiplexer chips (Mux chips). The partial crossbar interconnect of Fig. 1 further comprises a number of reprogrammable configurable logic chips 10, which in a presently preferred embodiment are field-programmable gate arrays (FPGAs). Each Mux chip 12 has one or more connections to each logic chip 10. In the preferred embodiment described in Butts, each design signal going from a logic chip to a Mux chip takes one physical interconnection. In other words, one signal on a pin from a logic chip 10 is interconnected to one pin on a Mux chip 12. In the embodiments of the present invention, each physical interconnection in the partial crossbar architecture may represent one or more design signals.

Each Mux chip 12 comprises a crossbar 22, together with a number of input demultiplexers 24 and output multiplexers 26. The input demultiplexers 24 take a time- multiplexed input signal and divide it into one or more component signals. The component signals are routed separately through the crossbar 22. They are then multiplexed again, in the same or a different combination, by an output multiplexer circuit 26. In a preferred embodiment, time-multiplexed signals are not routed through the Mux chip crossbar 22. By not routing time-multiplexed signals through the Mux chip crossbar 22, the flexibility of routing the partial crossbar network is increased because input signals and output signals to the Mux chips may be combined in different combinations. This also reduces the power consumption of the Mux chip 12 since the time-multiplexing frequency is typically much higher than the average switching rate of the component signals.

The logic chips 10 also comprise a plurality of input demultiplexers 34 and output multiplexers 36. The output multiplexers 36 take one or more internal logic chip 10 signals and combine them onto a single physical interconnection. The input demultiplexers 34 take a time-multiplexed signal and divide it into one or more internal logic chip 10 signals. In the presently preferred embodiment, these multiplexers 36 and demultiplexers 34 are constructed using the internal configurable logic blocks of a commercially available off-the-shelf FPGA. However, they could be constructed using input/output blocks of a reprogrammable logic chip custom designed for emulation. Fig. 1, for illustrative purposes only, shows two Mux chips 12 with four pins each and four logic chips 10 with two pins each. The actual embodiments of preferred hardware emulation systems would have more of each type of chip and each chip would have many more pins. The actual number of Mux chips 12, logic chips 10, and number of pins on each is purely a matter of design choice, and is dependent on the desired gate capacity to be achieved. In a presently preferred embodiment, each printed circuit board contains fifty-four Mux chips 12 and thirty-seven logic chips 10. The presently preferred logic chips 10 are the 4036XL FPGA (also known as a "logic cell array"), which is manufactured by Xilinx Corporation. It should be noted, however, that other reprogrammable logic chips such as those available from Altera Corporation, Lucent

Technologies, or Actel Corporation could be used. In the presently preferred embodiment, thirty-six of the logic chips 10 make five connections to each of the fifty-four Mux chips 12. What this means is that five of the pins of each of these thirty-six logic chips 10 has a physical electrical connection to five pins of each of the fifty-four Mux chips 12. The thirty-seventh logic chip 10 makes three connections to each of the fifty-four Mux chips. What this means is that three of the pins of this thirty-seventh logic chip 10 have a physical electrical connection to three pins of each of the fifty-four Mux chips 12.

Fig. 2 shows a example of a timing diagram for a two-to-one time-multiplexing emulation system in which internal logic chip Signal A 40 and internal logic chip Signal B 42 are multiplexed onto a single output signal 46. A Mux Clock Signal 44 is divided by two to produce Divided Clock Signal 50. A SYNC- Signal 48 is used to synchronize the Mux Clock divider 68 (see Fig. 3) so that the falling edge of Mux Clock 44 sets Divided Clock Signal 50 to zero if SYNC- Signal 48 is low. Divided Clock 50 is used to sample internal signal A 40 on each rising edge. This sample is placed into a storage element such as a flip-flop or latch (shown in Fig. 3). The same Divided Clock Signal 50 is used to sample internal Signal B 42 on each falling edge. This sample is placed into another flip- flop or latch (shown in Fig. 3). In a preferred embodiment, the Mux Clock Signal 44 may be asynchronous to Signal A 40 and Signal B 42. When the value on the Divided Clock Signal 50 is high, the previously sampled Signal A 40 is then transferred to the Output Signal 46. When the Divided Clock Signal 50 is low, the previously sampled Signal B 42 is transferred to the Output Signal 46.

Referring now to Fig. 3, the logic implemented in FPGA 10 of a presently preferred embodiment which creates the timing of the signals shown in Fig. 2 is shown in detail. A two-to-one clock divider 68 divides the Mux Clock Signal 44 to produce

Divided Clock Signal 50. Clock divider 68 comprises flip-flop 68a , AND gate 68b and inverter 68c. Divided Clock Signal 50 is input to an output multiplexer 66 (see multiplexer 36 of Fig. 1) and the input demultiplexer 64 (see demultiplexer 34 of Fig. 1). The clock divider 68 is reset periodically by the SYNC- Signal 48 to ensure that all the clock dividers in the system are synchronized. The input demultiplexer 64 is composed of two flip-flops 65a and 65b. Flip-flops 65a and 65b are clocked by Mux Clock 44. One flip-flop (e.g., 65b) is enabled when divided clock signal 50 is high and the other (e.g., 65a) is enabled when Divided Clock Signal 50 is low. Divided clock Signal 50 is not used directly as a clock to the flip-flops 65a, 65b in input demultiplexer 64 and in the output multiplexer 66 to conserve low-skew lines in the FPGA 10. The output of either flip-flop 65a or 65b provides a static demultiplexed design signal to the core 62 of the FPGA 10 (the core 62 of the FPGA 10 comprises the configurable elements used to implement the logic functions of the user's design). The output multiplexer 66 comprises two flip-flops 67a, 67b which are clocked by Mux Clock 44. Output multiplexer 66 also comprises two- to-one multiplexer 67c. One flip-flop (e.g., flip-flop 67b) is enabled when Divided Clock Signal 50 is high and the other flip-flop (e.g., flip-flop 67a) is enabled when Divided Clock Signal 50 is low. The two-to-one multiplexer 67c selects the output Q of either flip- flop 67a or flip-flop 67b to appear on the output pin.

Corresponding circuitry for the Mux chip 12 is shown in Fig 4. Unlike the circuitry in the logic chip 10, the output multiplexer 76 (see multiplexer 26 of Fig. 1) in the Mux chip 12 is constructed without flip-flops and therefore comprises two-to-one multiplexer 76a. This is possible because in the preferred embodiment, delays through the Mux chip 12 are short. To save additional logic, flip-flops 74a, 74b in the input demultiplexer 74 (see demultiplexer 24 of Fig. 1) do not have enable inputs. Instead, the Divided Clock Signal 50 is used to clock the flip-flops 74a, 74b directly. Clock divider 78 is preferably comprised of flip-flop 78a, AND gate 78b, and inverter 78c. The clock divider 78, the input demultiplexer 74, and the output multiplexer 76 operate similarly to the corresponding elements in Fig 3. Since it is not known in advance whether an input/output ("input/output") pin on a

Mux chip 12 will be an input or an output for a given design, all input/output pins in the Mux chips 12 include both an input demultiplexer 74 and an output multiplexer 76.

Using the concepts of the present invention, it is possible to do four-to-one time- multiplexing where a pin is an input for a time then an output for a time. Fig. 5 shows a timing diagram for four-to-one time-multiplexing. Just as for two-to-one time- multiplexing, there is a Mux Clock signal 44 and a SYNC- Signal 48. The Mux Clock Signal 44 is divided by two to produce a Divided Clock Signal 50. The divider is synchronously reset when the SYNC- Signal is low and a falling edge occurs on the Mux Clock Signal 44. In addition, there is an additional Direction Signal 80 which is produced by dividing the Divided Clock Signal 50 again by two. The Direction Signal 80 controls whether the pin is an input or an output at each instant in time. Four enable signals E0 90, El 92, E2 94 and E3 96 are used to enable individual flip-flops in the logic chips 10 as will be described later. These four signals are derived from the Divided Clock Signal 50 and the Direction Signal 80. The Divided Clock Signal 50 samples the External Signal 98 to produce Internal

Input Signal E 86 and Internal Input Signal F 88 when the Direction Signal 80 is low. When Direction Signal 80 is low, it signifies that the pin is operating in an input direction. Internal Input Signal E 86 is produced by sampling on the rising edge of Divided Clock Signal 50. Internal Input Signal F 88 is produced by sampling on the falling edge of Divided Clock Signal 50. When Direction Signal 80 is high, the pin receiving it operates as an output. Internal Output Signal C 82 is output onto External Signal 98 when Divided Clock signal 50 is low and Internal Output Signal D (84) is output when Divided Clock Signal 50 is high.

Referring now to Fig. 6, the logic implemented in logic chip 10 to create the timing signals of Fig. 5 is shown in detail. A clock divider 104 divides the Mux Clock signal 44 to produce Divided Clock Signal 50 and Direction Signal 80. Clock divider 104 is comprised of flip-flops 104a and 104b, AND gates 104c and 104d, inverter 104e, EXCLUSIVE-OR gate 104f, and AND gates 104g-104j. The clock divider 104 is reset periodically by the SYNC- Signal 48 to insure that all the clock dividers 104 in the system are synchronized. In addition, the clock divider circuit 104 also produces Enable Signals E0 90, El 92, E2 94 and E3 96. These signals are used as enables in the input/output multiplexer circuits 100 and 102.

The input/output multiplexer circuit 100 has timing corresponding to the diagram of Fig. 5. The External Signal 98 is an input when Direction Signal 80 is low. Signal E 86 and Signal F 88 are sampled from External Signal 98 when Enable Signal EO 90 and Enable Signal El 92 are active and placed in flip-flops 100a and 100b respectively. Signals D 84 and C 82 are saved in flip-flops 100c and lOOd when enable signals E2 94 and El 92 are active. A preferred input/output multiplexer circuit 100 is also comprised of multiplexer lOOe and buffer lOOf. These cause signals D 84 and C 82, previously saved in flip-flops 100c and lOOd, to appear successively on External Signal 98 when Direction Signal 80 is high.

The input/output multiplexer circuit 102 is similar except that the timing has been altered so that Signal 106 is an output when Direction Signal 80 is low. Input/output multiplexer 102 is preferably comprised of flip-flops 102a-102d, multiplexer 102e and buffer 102f. The input/output multiplexer 100 is referred to herein as an "inout" multiplexer while the multiplexer 102 is referred to herein as an "outin" multiplexer. When pins are connected together in a system, an inout pin must always be connected to an outin pin so that one pin is driving while the other is listening (i.e., ready to receive or receiving a signal).

Corresponding 4-way time-multiplexing circuitry is shown in Fig. 7 for mux chip 12. Clock divider 132 produces Divided Clock Signal 50 and Direction signal 80. Clock divider 132 is comprised of flip-flops 132a, 132b, AND gates 132c, 132d, inverter 132e and EXCLUSIVE-OR gate 132f. As in the logic chip 10, there is an inout multiplexer 120 and an outin multiplexer 122. Inout multiplexer 120 is preferably comprised of flip- flops 120a, 120b, two-to-one multiplexer 120c and buffer 120d. Inout multiplexer 120 has the timing shown in Fig. 5. External Signal 98 is an input when Direction Signal 80 is.low and an output when Direction Signal 80 is high. Internal signals 124 and 126 are sampled from External Signal 98 when Direction signal 80 is low. Internal signals 128 and 130 are output onto External Signal 98 when Direction signal 80 is high.

Outin multiplexer circuit 122 is similar except that the timing has been altered so that signal 134 is an input when Direction Signal 80 is high and an output when Direction Signal 80 is low. Outin multiplexer 122 is preferably comprised of flip-flops 122a, 122b, two-to-one multiplexer 122c and buffer 122d. An outin pin on a mux chip 12 must connect to an inout pin on another mux chip 12 or a logic chip 10. Additional configuration bits (not shown in Fig. 7) make it possible to programmably configure any pin of the mux chip 12 to be either non-multiplexed, two-to-one multiplexed as either an input or an output, or four-to-one multiplexed as either an inout or an outin pin. This is done by selectively forcing direction signal 80 to always be low (for a two-to-one input), always be high (for a two-to-one output), be non-inverted (for an inout four-to-one pin as in 120), or be inverted (for an outin four-to-one pin as in 122). Additionally, external signal 98 can be directly connected to core signal 124 for a non-multiplexed input. Core outputs 128 and 130 can be directly connected to the input and enable pins of buffer 120d for a non-multiplexed output.

Although the preferred embodiment incorporates two-to-one and four-to-one time- multiplexing, the technique disclosed could be extended to allow multiplexing by any other factor that the designer might choose. In general, higher multiplexing factors result in slower emulation speed but allow simpler and lower-cost hardware because the physical wires and pins can be shared among more logical design signals.

Furthermore, there are many other methods for multiplexing multiple bits of information onto a single physical wire which could be used in an emulation system. Examples of these techniques are pulse- width modulation, phase modulation and serial data encoding. The choice of which technique to use in a particular embodiment is a matter of the designer's choice and depends on the tradeoffs between operating speed, cost, power consumption and complexity of the logic required.

One aspect of these more complex encoding schemes which is important in a hardware emulation system is the ability to reduce power consumption. A hardware emulation system typically will have many thousands of interconnect paths. To mmimize delay through the system, it is desirable to switch these interconnect paths as rapidly as possible between different logical design signals. Power consumption of the system, however, is largely determined by the speed at which the interconnect paths are switched. In a large system, generating and distributing power and removing the resulting heat can significantly increase the complexity and cost of the system. It is therefore desirable to have a multiplexing scheme which operates quickly but does not require large amounts of power. One way in which power dissipation could be minimized is by only transferring design signal information when design data changes rather than transferring design signal information continuously, as is done in the presently preferred embodiment. Another important aspect to consider when choosing an encoding scheme is the ability to have interconnections which operate asynchronously to each other or asynchronously to a master multiplexing clock. In the simple form of time-multiplexing described above for the presently preferred embodiment, a master multiplexing clock must be distributed with low skew to all logic chips 10 and Mux chips 12 in the system. In addition, the master multiplexing clock must be run slow enough so signals have time to pass over the longest interconnect path in the system. At the same time, there must be no hold-time violations for the shortest interconnect path in the system. A hold time violation could occur if a transmitting device removed a data signal before a receiving device had properly saved it into a flip-flop or latch. The requirement for a low-skew master clock significantly increases the complexity and cost of the emulation system. In addition, the requirement to not have hold time violations on the shortest possible data path while insuring sufficient time for signals to pass over the longest possible data path means that the multiplexing clock must operate relatively slowly. As explained earlier, this is undesirable because it limits the effective operating speed of the emulation system. The inventive concepts described above with respect to the simplest form of time- multiplexing are equally applicable to more complex encoding schemes, which will now be seen. Encoding schemes using pulse-width modulation, phase-shift modulation and serial encoding can reduce power consumption and and increase the relatively low operating speed intrinsic to the simplest form of time-multiplexing. The disadvantage of all of these schemes (relative to simple time-multiplexing) is that they require significantly more encoding and decoding logic and, for that reason, simple time-multiplexing was used in the presently preferred embodiment. As the cost of digital logic decreases relative to the cost of physical pins and circuit board traces, one or more of these more complex encoding schemes will likely be used in the future.

Referring to Fig. 8, a form of pulse-width modulation is shown which would be suitable for a hardware emulation system. The External Signal 146 is normally low. When a transition occurs on a Design Signal 140 or 142, a pulse is emitted on the External Signal 146. A High Speed Asynchronous Clock Signal 144 is distributed to all chips in the system. Unlike the Mux Clock 44 described earlier with reference to Fig. 2,

Asynchronous Clock Signal 144 need not be synchronized between any two chips in the system or even between two pins on the same chip. Therefore, there is no need for a SYNC- Signal 48 as described earlier with reference to Fig. 2. Also, Asynchronous Clock Signal 144 may operate at any speed as long as the minimum pulse width produced on External Signal 144 will pass through the interconnect without undue degradation. The pulse emitted on External Signal 146 may have a width of one, two, three or four clocks depending on whether the two Design Signals 140 and 142 had values of 00, 01, 10 or 11 when a signal transition occurred. Asynchronous Clock Signal 144 must, however, be sufficiently fast that five clock cycles always elapse between successive edges of Design Signals 140 and 142 to ensure that information is not lost. Data Signals 140 and 142 are recovered from External Signal 146 by counting the number of Asynchronous Clock 144 cycles that occur each time External Signal 146 goes high. In an actual embodiment, Asynchronous Clock 144 would operate at twice or three times the speed shown to ensure that recovered signals could be unambiguously distinguished. Additional circuitry would also be added to periodically transfer data, even in the absence of design signal transitions in order for the design to initialize properly.

Since Design Signals 140 and 142 transition relatively infrequently on average compared to Asynchronous Clock 144, power consumption will be low compared to the continuous time-multiplexing scheme described earlier. In addition, this encoding scheme is not affected by varying amounts of delay between the transmitting circuit and the receiving circuit.

The logic circuitry necessary to implement this pulse-width encoding scheme could be designed by one skilled in the art of circuit design and thus will not be further discussed here. It is noted, however, that one skilled in the art could design logic circuits having many different variations while still achieving the same function. For example, three design signals could be encoded onto one external signal 146 instead of two. Also different encodings of Design Signals 140 and 142 could be used or the default value of External Signal 146 could be one instead of zero. The pulse width modulation encoding scheme described with reference to Fig. 8 suffers from the following limitations. In a pulse width modulation encoding scheme, the pulse width must be measured from a rising edge on External Signal 146 to a falling edge on External Signal 146. However, when a signal passes through many levels of routing chips, a rising edge will often be delayed by a different amount than a falling edge. The speed of the signal multiplexing may, therefore, need to be slowed down to ensure that signal values can still be distinguished after passing through many levels of routing chips. Also, the modulation scheme of Fig. 8 is sensitive to unavoidable momentary signal transitions or glitches on External Signal 146 which may cause false signal values to be transmitted. Referring to Fig. 9, a form of phase modulation is shown which would be suitable for a hardware emulation system. An internal phase-locked loop ("PLL") circuit continuously counts from zero to three (shown as PLL Count 150 in Fig. 9) using Asynchronous Clock 144 as an input. The PLL circuit may be of a type commonly known as a digital phase-locked loop ("DPLL") which is relatively easy to construct with complementary metal oxide semiconductor ("CMOS") integrated circuit technology. When a transition occurs on Design Signals 140 or 142, External Signal 152 makes a transition at a time which depends on the value of Design Signals 140 and 142. For example, after the first transition on Signal A 140, both Signal A 140 and Signal B 142 will be high. External Signal 152, therefore makes a transition when the PLL is at count 3 (A, B = 11). Later, after a transition on Signal B 142, Signal A 140 will be high and signal B 142 will be low. External signal 152 therefore makes a transition when the PLL is at count 2 (A, B = 10).

The receiving circuit has a matching PLL which is kept synchronized to the transmitting PLL by sync pulses which are sent periodically when no data needs to be transferred. A sync pulse consists of two transitions occurring at time zero and time two of the transmitting PLL. A sync pulse may be recognized by the receiving PLL because it is the only time when two transitions occur on external signal 152 within one PLL cycle. The sync pulse causes the receiving PLL to adjust its count gradually so that it becomes synchronized with the transmitting PLL after several sync pulses have occurred. The sync pulse need only occur relatively infrequently compared to transitions on Signals A 140 and Signal B 142 so power consumption is not greatly increased. In an actual embodiment, Asynchronous Clock 144 would operate at a relative speed two or three times what is shown in Fig. 9 to have sufficient resolution to clearly distinguish between the different edge transition times on External Signal 152. Alternatively, the phase-locked loop could be run at a multiple of the frequency of Asynchronous Clock 144 to increase resolution. Also, circuitry would be included to periodically transmit the value of Design Signal A 140 and Design Signal B 142 even if no transition had occurred, so that the design would initialize properly. The circuitry necessary to implement the digital phase-lock loops and the transmit and receiving circuitry used in this phase encoding scheme could be designed by one skilled in the art of circuit design and thus will not be further discussed here.

The phase modulation encoding scheme discussed above has several advantages over the pulse-width modulation scheme discussed earlier (see Fig. 8). Fewer transitions on External Signal 152 are required to transmit values of Signal A 140 and Signal B 142 than is the case for External Signal 146 in Fig. 8. This reduces the power consumed by the system. Also, the circuit can be made less sensitive to noise because glitches or short pulses are treated as sync pulses and have only a gradual effect on PLL Count 150. In addition, separate PLL counters can be used to time rising edges and falling edges since the sync pulse always includes one rising and one falling edge. By timing the rising and falling edges separately, Asynchronous Clock 144 can be run at a very high frequency and External Signal 152 can be passed through many intermediate routing chips without affecting the ability to reliably recover Signal A 140 and Signal B 142. The main disadvantage of phase modulation, however, is that it requires a relatively large amount of digital logic to implement.

Many variations of the phase modulation encoding scheme disclosed herein are possible without deviating from the teachings of the invention. For example, the PLL could recognize eight or sixteen transition times rather than just four. Also, additional design signals could be transmitted by creating more than one edge on External Signal 152 each time a transition occurred on a design signal. For example, Design Signals A and B could be transmitted on a first edge of External Signal 152 and Design Signals C and D could be transmitted on a second edge of External Signal 152. This has the effect of transmitting more data on External Signal 152 but at a lower speed. Referring to Fig. 10, another form of modulation is shown which would also be useful in a hardware emulation system. This technique is known as serial data encoding. Many common protocols such as RS232 use a variation of serial data encoding. When Design Signal A 140 or Design Signal B 142 make a transition, a serial string of data is transmitted on External Signal 162. A start bit which is always zero signifies that a transmission is about to occur. Next, the values of Signal A 140 and Signal B 142 are transmitted successively. Finally, a stop bit which is always a one is transmitted. The receiving circuitry uses Asynchronous Clock Signal 144 to delay one and one-half clocks from the falling edge of the start bit before sampling External Signal 162 to recover Signal A 140. It then delays an additional clock before sampling External Signal 162 again to recover Signal B 142. In an actual embodiment, Asynchronous Clock 144 would operate at a relative frequency several times higher than that shown in Fig. 10 to sample External Signal 162 accurately at the center point when Signal A 140 and Signal B 142 are being transmitted. The circuitry necessary to implement the serial data encoding scheme could be designed by one skilled in the art of circuit design and thus will not be further discussed here.

Serial data encoding has the advantage that relatively simple digital logic may be used. It has the disadvantage, however, that several edges on external signal 162 are required to transmit each change to Design Signal A 140 and Design Signal B 142. This means that the data rate is relatively low and the power consumption relatively high compared to other techniques.

Many variations of the serial data encoding scheme disclosed herein are possible without deviating from the teachings of the invention. For example, values for more than two design signals could be transmitted each time a design signal makes a transition.

Any of the encoding techniques shown in Figs. 8-10 could be further improved by the addition of some form of error checking technique. Since design data is only transmitted when a design signal changes, transmission errors will result in wrong data values being latched by the receiving circuits and the probability of incorrect operation of the emulation system. Common error detection and correction techniques such as parity or cyclic redundancy checking (CRC) could be used.

The system aspects of a preferred embodiment will now be disclosed in more detail. Referring to Fig. 11, a block diagram of the logic board 200 of a preferred embodiment is shown incorporating logic chips (which in the presently preferred embodiment are FPGAs) and Mux chips 12. The logic board 200 has a partial crossbar interconnection similar to that disclosed in Butts et al. The main difference is that the partial crossbar of the presently preferred embodiment of the present invention is not completely uniform because logic chip 204, which will be discussed below, has fewer connections with Mux chips 12 than do the other logic chips. In the presently preferred embodiment, there are fifty- four Mux chips 12 with two-hundred and sixty input/output pins on each and thirty-six logic chips (FPGAs) 10 with two-hundred and seventy input/output pins each. The presently preferred embodiment utilizes FPGAs as logic chips 10 with the part number XC4036XL manufactured Xilinx Corporation, San Jose, California, U.S.A. Each of the thirty-six logic chips 10 has five connections to each of the fifty-four Mux chips 12. A thirty-seventh logic chip 204, known herein as the co- simulation (CoSim) logic chip has three connections to each of fifty-four mux chips 12. In a presently preferred embodiment, this thirty-seventh logic chip 204 is also an FPGA manufactured by Xilinx having part number 4036XL. Additional pins (not shown) on Mux chips 12 and logic chips 10 and 204 are reserved for downloading, clock distribution, and other system functions. The purpose of CoSim logic chip 204 will be discussed below. Any of the Mux chip 12 to logic chip 10 connections may be non-multiplexed, multiplexed two-to-one, or multiplexed four-to-one by programming the mux chips 12 and logic chips 10 appropriately. In addition to the interconnections discussed above, CoSim logic chip 204 is also in electrical communication with a processor 206. In the presently preferred embodiment, the processor 206 is a PowerPC 403 GC chip available from IBM corporation. Processor 206 is used for co-simulation, which is described in copending application serial no. 08/733,352, entitled Method And Apparatus For Design Verification Using Emulation And Simulation, to Sample et al. The teachings of application serial no. 08/733,352 are incorporated herein by reference. Processor 206 is also used for diagnostic functions and downloading information to Mux chips 12, logic chips 10, 204 and RAM 208 (discussed below) and SGRAM 210 (discussed below). The processor 206 is connected through a VME interface (not shown) to backplane connector 220. In the presently preferred embodiment, twelve of the logic chips 10 also have connections to a 64K by 32 static random access memory (RAM) chip 208. This RAM chip 208 is used for implementing large memories which may be part of an emulated circuit. The RAM 208 is attached to some of the lines also connecting the logic chips 10 to the mux chips 12. In this way, if the RAM is not used, the logic chip 10 to mux chip 12 connections can be used for ordinary interconnect functions and are not lost. If the RAM 208 is needed for implementing memory that is part of a particular netlist, the logic chip 10 that communicates with it has a RAM controller function programmed into it.

The mux chips 12 also have connections to a backplane connector 220 and a turbo connector 202. Backplane and turbo connections may also be either non-multiplexed, multiplexed two-to-one, or multiplexed four-to-one. The turbo connector 202 is used to electrically connect two logic boards 200 together in a sandwich. By providing direct connections between two logic boards in a pair, the number of backplane connections required for a particular design may be reduced. The backplane connector must fit along one edge of the logic board and the number of possible backplane connections is limited by the types of connectors available. If there are insufficient backplane connections, the partitioning software will not be able to operate efficiently, thereby reducing the logic capacity of the board. Two emulation boards connected in a sandwich are shown in Fig. 13. If a smaller emulation system comprising less than two emulation boards is desired, a special turbo loopback board having no logic disposed thereon is used. In such a system, the special turbo loopback board simply routes signals from turbo connector 202 to backplane connector 220. An example of a configuration using a turbo loopback board is shown in Fig. 15.

In addition, the Mux chips 12 have eight connections each to a set of synchronous graphics RAMs (SGRAMs) 210. These SGRAMs 210 are used to form the data path of a distributed logic analyzer. Design signals may be sampled in the logic chips 10 and CoSim logic chip 204 and routed through Mux chips 12 then saved in SGRAMs 210 for future analysis by the user. The logic analyzer is disclosed further below.

Logic chips 10 and CoSim logic chip 204 are also attached to an event bus 212 and a clock in bus 214. The event bus is used to route event signals from within logic chips 10 and CoSim logic chip 204 to logic analyzer control circuitry (shown in Fig. 20a, discussed below). The event bus consists of four signals and is time-multiplexed two-to-one to provide eight event signals. The signals on the event bus 212 are buffered and then routed to additional pins (not shown) on backplane connector 220. The clock in bus 214 consists of eight low-skew special purpose clock nets which are routed to all logic chips 10 and CoSim logic chip 204 (discussed below). The clock in bus 214 is used to distribute clock signals as is explained in United States Patent No. 5,475,830. Clocks from clock in bus 214 may come directly through buffer 216 from signals 218 which are connected to additional pins (not shown) on backplane connector 220 or they may be created by combining primary clock signals 218 with logic in CoSim logic chip 204. When CoSim logic chip 204 is used for implementing clock logic, it is acting as a "clock generation FPGA" as explained in United States Patent No. 5,475,830. Referring now to Fig. 12, the interconnection among boards is shown. Logic boards 200 are assembled into pairs which are connected through turbo connectors 202. The logic boards are also connected through the backplane connectors 220 (shown in Fig. 11) to a switching backplane 420. The switching backplane 420 is comprised of mux boards 400 which are disposed at right angles to the logic boards. An arrangement of logic boards and switching boards can be seen in United States Patent No. 5,352,123 to Sample et al and assigned to the same assignee as the present application. United States Patent No. 5,352,123 is incorporated herein by reference in its entirety. The switching backplane 420 also connects to input/output boards 300 (only one input/output board 300 is shown in Fig. 12. However, the use of more than one input/output board 300 is contemplated as part of the present invention), input/output boards 300 serve the functions of routing and buffering signals from external devices contained on core board 500 or external system 540. They also have the ability to provide stimulus signals to all external pins so that the emulated design can be operated in the absence of an external device or system. input/output boards 300 connect through core board 500 and repeater pod 520 to an external system 540. To simplify Fig. 12, the actual numbers of boards and connections have been reduced. In a presently preferred embodiment, there are twenty-two mux boards 400, one to ten pairs of logic boards 200 and up to eight input/output boards 300. In the presently preferred embodiment, if more than two input/output boards 300 are used, a pair of logic boards 200 are lost for each additional pair of input/output boards 300. In the presently preferred embodiment, each input/output board 300 has one associated core board 500 which has up to seven repeater pods 520 which are attached to cables. Each repeater pod in the presently preferred embodiment buffers eighty-eight bidirectional signals.

Fig. 13 shows the physical construction of the preferred embodiment system. Mux boards 400 are disposed at right angles to logic boards 200 and input/output boards 300. Backplane 800 has connectors on one side for mux boards 400 and on the other side for logic boards 200 or input/output boards 300. To simplify the drawing, only one mux board 400 and three pairs of logic boards 200 are shown. However, in a presently preferred embodiment, there are, in fact, twenty-two mux boards 400 and up to eleven pairs of logic boards 200 or input/output boards 300. input/output boards 300 attach to core boards 500 through connector 330. Core boards 500 have an external connector 510, Λvhich attaches through a cable to repeater pod 520 and external system 540 (not shown in Fig. 13). A power board 240 converts from a forty-eight volt DC main power supply to the 3.3 volts necessary to power the logic board. This type of distributed power conversion is made necessary by the time-multiplexing circuitry's high demand for power. In addition, the system contains a control board 600 and a CPU board 700 (see Fig. 20). In a presently preferred embodiment, the CPU board 700 is a VME bus Power-PC processor board available from Themis Computer and others. Other similar processor boards would be suitable. The selection of the particular processor board to use depends on tradeoffs between cost, speed, RAM capacity and other factors. The CPU board 700 provides a network interface and overall control of the emulation system. The control ' board 600 provides clock distribution, downloading and testing functions for the other boards as well as centralized functions of the logic analyzer and pattern generator (the structure and function of which will be discussed below). A smaller version of the presently preferred emulation system can also be constructed. A block diagram of this system is shown in Fig. 14. The smaller system does not have a switching backplane 420. Instead, logic boards 200 are connected directly together and to input/output boards 300. This is possible because the size of the system is limited to two pairs of logic boards 200 and one pair of input/output boards 300. The backplane connections are shown at the top of Fig. 14. Pins from each backplane connector 220 (shown in Fig. 10) are divided in to 4 equal groups. Each group is routed through the backplane to one of the two logic boards 200 not in the same pair and to each input/output board 300. It is not necessary to make connections through the backplane to the other logic board 200 or input/output board 300 in the same pair because this connection is provided through the turbo connector 202 in the case of logic boards 200 and is not necessary in the case of input/output boards 300. The connection pattern shown in Fig. 14 provides sufficient richness for good routability between boards but avoids the high cost of a switching backplane 420. As in the large system, input/output board 300 is connected through core board 500 and repeater pod 520 to an external system 540. To simplify the drawing, core board 500, repeater pod 520, and external system 540 are not shown for the second input/output board although they are, in fact, present. By using a set of additional boards to make connections between otherwise unused backplane and turbo connectors, versions of the small system may be constructed with one to four logic boards 200 and either one or two input/output boards 300. These additional boards are turbo loopback board 260 and backplane loopback board 280 shown in Fig. 15. Neither of these boards have any digital logic on them. They simply route signals between connectors.

A physical drawing of the small system with one logic board and one input/output board is shown in Fig. 15. Backplane 802 provides the connections described earlier with reference to Fig. 14. input/output board 300 is connected through connector 330 to core board 500. Core boards 500 have an external connector 510 which attaches through a cable to repeater pod 520 and external system 540 (not shown in Fig. 15). A power board 240 converts from a forty-eight volt DC main power supply to the 3.3 volts necessary to power the logic board. In addition, the small system contains a control board 600 and a CPU board 700 as in the large system described earlier with reference to Fig. 13. To preserve routing connections when less than four logic boards are used, turbo loopback board 260 connects signals from unused turbo connectors 202 (shown in Fig. 11) of logic board 200 to the backplane 802. The turbo loopback board 260 is used when there are either one or three logic boards 200 in the system. An additional pair of backplane loopback boards 280 are used to preserve routing connections through the backplane when there are unused logic board slots. This occurs when there are either one or two logic boards in the system. The backplane loopback boards 280 connect the groups of backplane signals (shown in Fig. 14) to each other so that no signals are lost when there are otherwise vacant backplane connectors.

A block diagram of input/output board 300 and core board 500 is shown in Fig. 16. A first row 301 of Mux chips 12 is attached to backplane connector 320 on input/output board 300. To simplify the drawing, only three mux chips 12 are shown in the first row 301. In a presently preferred embodiment, however, there are fourteen Mux chips 12 in the first row 301. A second row 303 of mux chips 12 connects to the first row 301 of Mux chips 12 as well as to field effect transistors (FETs) 308 and logic chips 304. Again, the drawing has been simplified to only show two Mux chips 12 . In a presently preferred embodiment, there are twelve Mux chips 12 in the second row 303. Two rows 301, 303 of Mux chips 12 are required to achieve sufficient routing flexibility so that any arbitrary external signal can be connected to any pin of repeater cable connectors 510 on core board 500. Logic chip 304 also is attached to synchronous graphics RAM (SGRAM) 302. In a presently preferred embodiment, logic chip 304 is a FPGA. Although only one logic chip 304 and one SGRAM 302 is shown, in a presently preferred embodiment, there are six logic chips 304 and six SGRAMs 302 on input/output board 300. Logic chips 304 and SGRAMs 302 provide the capability of driving stimulus vectors into the emulator on any external connection pin. When driving stimulus vectors, FETs 308 are turned off (i.e., are opened) so the stimulus will not conflict with signals from an external system which may be attached through repeater pods 520 to connectors 510. When not driving stimulus vectors, pins of logic chips 304 are tristated and FETs 308 are turned on (i.e., closed) so that signals on connectors 510 may drive or receive signals from second row mux chips 303. In the presently preferred embodiment, logic chips 304 are the XC4028, which is available from Xilinx Corporation, San Jose, California, although other programmable logic chips could be used with satisfactory results. In addition to the components shown in Fig. 16, the input/output board 300 contains a processor chip (not shown) which is connected through a VME interface to backplane connector 320. In a presently preferred embodiment, this processor chip is a PowerPC 403 GCX from IBM corporation, although other microprocessor chips could be used with satisfactory results. The processor chip attaches through processor bus 310 to logic chips 304. Processor bus 310 serves to upload stimulus information into SGRAMs 302. The processor is used for diagnostic functions and for uploading and downloading information from Mux chips 12, logic chips 304 and SGRAMs 302.

Connector 330 attaches core board 500 to input/output board 300. In addition to logic signals coming from FETs 308, this connector 330 receives JTAG signals and is electrically connected to the VME bus. The JTAG signals are for downloading and testing repeater pods 520 which may be plugged into connectors 510. In a presently preferred embodiment, the VME bus is not used with core board 500. However, it is contemplated that the VME bus could be used with other types of boards which may be plugged into connector 330. For example, it is contemplated that a large memory board might be plugged into connector 330 to provide the ability to emulate memories larger than will fit into RAMs 208 (shown in Fig. 11).

Referring now to Fig. 17, a block diagram of one embodiment for a mux board 400 is shown. Mux chips 12 attach to backplane connector 420 in a distributed fashion. The drawing of Fig. 17 has been simplified to only show four Mux chips 12. However, in a presently preferred embodiment, there are, in fact, seven Mux chips on mux board 400. Furthermore, there are many more connections to Mux chips 12 than are shown in Fig. 17. These additional connections are arranged similarly to the ones shown. In addition to the Mux chips 12 shown in fig. 17, mux board 400 contains a JTAG interface (not shown) attached to backplane connector 420 which allows the Mux chips 12 to be downloaded and tested.

The mux board of Fig. 17 is suitable for a non-expandable emulation system. It is often desirable, however, to connect several emulation systems together to form a larger capacity emulation system. In this case, an expandable version of mux board 400 is used. A block diagram of one embodiment of an expandable mux board 402 is shown in Fig. 18a. A first row 404 of Mux chips 12 is electrically connected to backplane connector 420. The drawing has been simplified to show only four Mux chips 12 in the first row 404. However, in one embodiment, there are ten Mux chips 12 in the first row 404. The first row 404 of Mux chips 12 are electrically connected to a second row 406 of Mux chips 12 and to a turbo connector 430. The second row 406 of Mux chips 12 is also electrically connected to turbo connector 430 and to external connectors 440. Only two Mux chips 12 are shown in the second row 406, and only two external connectors 440 are shown in Fig. 18a. However, in one embodiment, there are five Mux chips 12 in the second row 406. Furthermore, there are six external connectors 440 in one embodiment. Each external connector 440 of the embodiment of Figure 18a has ninety-two input/output pins. In this embodiment, mux boards 402 are assembled into pairs which are attached together through turbo connector 430. Turbo connector 430 acts to expand the effective intersection area between a pair of mux boards 402 and a pair of logic boards 200. Using the turbo connector 430 increases the intersection area, which increases the effective routability between external connectors 440 and logic boards 200.

A block diagram of a presently preferred expandable mux board 1402 is shown in Fig. 18b. A first row 1404 of Mux chips 12 is electrically connected to backplane com ector 1420. The drawing has been simplified to show only four Mux chips 12 in the first row 1404. However, in a presently preferred embodiment, there are nine Mux chips 12 in the first row 1404. The first row 1404 of Mux chips 12 are electrically connected to a second row 1406 of Mux chips 12. The second row 1406 of Mux chips 12 is electrically connected to external connectors 440. Only two Mux chips 12 are shown in the second row 1406, and only two external connectors 1440 are shown in Fig. 18b. However, in a presently preferred embodiment, there are three Mux chips 12 in the second row 1406. Furthermore, there are three external connectors 1440 in the presently preferred embodiment. Each external connector 1440 of the presently preferred embodiment has one hundred thirty input/output pins. Mux boards 1402 are assembled in pairs.

With reference to Fig. 19, the manner in which user clocks are distributed in the emulation system is described. Distribution of user clocks is important in emulation system design. As is discussed in United States Patent No. 5,475,830, it is necessary to ensure that user clocks arrive at the logic chips 10 on emulation boards 200 before data signals, assuming that the user clocks and data signals change at the same time in external system 540 (external system 540 is shown in Fig. 12 and 14). It is possible to satisfy this requirement by delaying the data signals. This solution, however, slows down the maximum operating speed of the emulation system. A more desirable alternative is to make the user clock distribution network as fast as possible so that minimal, if any, delay needs to be added to the data signals.

Fig. 19 shows the clock distribution for a preferred hardware emulation system. Clocks may enter the system either through a clock connector 620 on control board 600, through multi-box clock connector 630 on control board 600, or as a normal signal on connector 510 of core board 500. As discussed, core board 500 is attached to input/output board 300. For simplicity, only one connector 510 is shown in Fig. 19. However, in a presently preferred embodiment, there are seven connectors 510 on each core board 500. Also, the system may contain multiple input/output board/core board combinations. As described earlier with reference to Fig. 12 and 14, connector 510 attaches to repeater pod 520 which connects to an external system 540. If clock connector 630 is used to input clocks, connector 620 will be also attached through a cable to external system 540. Clock connector 620 provides a faster method for clocks to enter the emulation system while connectors 510 on core boards 500 provide an easier method for the user.

Connector 510 on core board 500 connects through connector 330 and FETs 308 to a second row 303 Mux chip 12 on input/output board 500 as described earlier with reference to Fig. 16. Second row 303 Mux chip 12 connects to dedicated clock pins on backplane connector 320 in addition to other connections described earlier. In a presently preferred embodiment, there are sixteen of these pins. From input/output board backplane connector 320, clocks connect through backplane 800 or 802 to control board 600 (see Fig.13). On control board 600, a Mux chip 12 is used to select a combination of clocks from all of the different potential sources. The system may have up to thirty-two distinct clock sources. Any eight of these may be used on a pair of emulation boards 200. This allows different pairs of emulation boards 200 to have different clocks as might be required, for example, when more than one chip design was being emulated in a single hardware emulation system. Clocks are routed through programmable delay element 604 and buffers 614 then through backplane 800 or 802 to emulation boards 200. As described earlier with reference to Fig. 11, clocks on emulation board 200 may be routed either through buffer 216 or clock generation logic chip 204 (i.e., CoSim logic chip) before going to logic chips 10.

Logic analyzer clock generator logic chip 602 on control board 600 may also generate clocks. This typically happens when running the system with test vectors. Data from clock RAM 612 is input to a state machine programmed into logic analyzer clock generator logic chip 602 which allows different clock patterns to be created such as return- to-zero, non-return-to-zero, two-phase non-overlapping, etc. Design of such a state machine is well understood to those skilled in the art of control logic design and will not be further described here. From logic analyzer clock generator logic chip 602, the thirty- two generated clocks are communicated to the clock selection Mux chip 12. In a presently preferred embodiment, logic analyzer clock generator logic chip 602 is an XC4036XL device manufactured by Xilinx Corporation, although other programmable logic devices could be used with satisfactory results.

Multi-box clock connector 630 may serve either to input clocks or to output clocks. Direction is controlled by buffer 608. In a multi-box emulation system, i.e., an emulation system comprised of more than one stand-alone emulation system, one box is designated as the master and the others are designated as slaves. The master box produces the clocks on its multi-box clock connector 630 which are then input to all other slave emulation systems through their multi-box clock connectors 630. In a multi-box system, delay element 604 is programmed in the master box to compensate for the inevitable cable delays between the master and slave boxes.

It will be recognized by one skilled in the art that Fig. 19 has been considerably simplified for clarity and that there are a large number of interconnections and components not shown. The need for these additional components and interconnections are a matter of design choice.

Referring now to Fig. 20, the control structure of the hardware emulation system will be discussed. Previous hardware emulation systems have generally suffered from insufficient processing capability. This resulted in long delays when transferring data to or from the system, when loading design data into the system, and when running hardware diagnostics. In a preferred embodiment of the present invention, a two level processor architecture is used to alleviate this problem. A main processor 700 is attached to control board 600. In a presently preferred embodiment, processor 700 is a Power PC VME based processor card available from Themis Computer, although other similar cards could be used with satisfactory results. Processor 700 is electrically connected to the Ethernet and to VME bus 650 on control board 600. VME bus 650 is electrically connected through an interface (not shown in Fig. 20) to backplane 800 or 802, and then to logic boards 200 and input/output boards 300. VME bus 650 also connects through JTAG interface 660 on control board 600 and backplane 800 to the mux boards 400. Each logic board 200 and input/output board 300 has a local processor with a VME interface and memory. This circuit will be discussed with reference to logic board 200 although a similar circuit exists on each input/output board 300. Processor 206 (shown earlier on Fig. 11) is electrically connected through VME interface 222 to VME bus 650 on backplane 800 or 802. It is also electrically connected to a Controller 221. In a preferred embodiment, controller 221 is comprised of several XC4028 FPGAs from Xilinx Corporation. Controller 221 provides JTAG testing signals to other components on logic board 200. In addition, various devices such as flash EEPROM 224 and dynamic RAM 226 connect to processor 206. Processors 206 can operate independently when doing board level diagnostics, loading configuration data into logic chips 10 or transferring data to and from memories 208 and 210 (shown earlier on Fig. 11).

Referring now to Fig. 20a, the logic analyzer circuit for the preferred embodiment system will be discussed in detail. The logic analyzer is distributed. This means that portions of the logic analyzer are contained on each logic board 200 while centralized functions are contained on control board 600. Events, i.e., combinations of signal states in the design undergoing emulation, are generated inside the logic chips 10 and 204 on the logic boards 200. These are combined in pairs and output on signals 236, which are then ANDed together in a special event logic chip 232 (shown in Fig. 20a as AND gate 232). The resulting combined event signals are separated into eight signals by flip-flops 230 (for simplicity, only two flip-flops 230 are shown in Fig. 20a). Separated event signals 240 then go through the backplane 800 or 802 (not shown in Fig. 20a) to the control board 600 where they are again AND'ed by AND gate 678 (which is part of a logic chip) with events from other boards or other boxes. Connector 670 may contribute event signals from other emulation boxes. The final event signals go to the trigger generator logic chip 674 on the control board 600 which computes a trigger condition and conditional acquisition condition and generates an acquire enable signal 238 which controls acquisition of data on the logic boards 200. The output of the trigger generator logic chip 674 is sent through buffer 671 to connector 672 and through delay element 676. The output of delay element 676 is buffered by buffers 673 and sent across backplane 800 or 802 to a logic analyzer memory controller 234 on logic boards 200. The control board 600 also generates the trace and functional test clocks and other logic analyzer/pattern generator signals.

Referring now to Fig. 20b, the data path for logic analyzer signals is shown. Data signals are latched in the logic chips 10 and 204 and scanned out into synchronous graphics RAMs (SGRAMs) 210 on the emulation boards 200. The logic analyzer data path is distributed across all the logic boards 200. Each Mux chip 12 on the logic boards 200 has eight pins connected to a 512Kx32 SGRAM 210. The SGRAM 210 operates at high speed while the emulation is running to save logic analyzer data. Data is time- multiplexed anywhere from two-to-one to sixty four-to-one, depending on the desired logic analysis speed, channel depth and number of probed signals as shown in the chart below: Logic Analyzer Tradeoffs

Max Speed Depth Channels/Logic Board Time-mux factor

16 MHZ 128K 864 2-1

8 MHZ 64K 1,728 4-1

4 MHZ 32K 3,456 8-1

2 MHZ 16K 6,912 16-1

1 MHZ 8K 13,824 32-1

.5 MHZ 4K 27,648 (All Signals) 64-1

The maximum speed numbers shown above are approximate and will vary depending on the logic analyzer design and the multiplexing clock speed.

At a .5 MHZ rate, a sufficient number of channels are available so that it is possible to probe every flip-flop or latch in the emulated design simultaneously. When a signal is "probed", the value of the signal at that element or node is read. Generally, this value is then stored in a memory element (SGRAM 210). By reconstructing combinational signals in software, the user can view any set of signals for several thousand clocks around a trigger condition without moving probes or even restarting the emulator. When it is desired to probe a combinational signal, the software examines the design netlist. A cone of logic is extracted in which each combinational logic path leading to the desired signal is traced backwards until it terminates either at a probed storage element (i.e., a flip-flop or a latch) or at an external input of the design. The logic function for the desired signal is then derived in terms of all the storage elements or external inputs contributing to it. Finally, the value of the desired signal is calculated for each instant of time by evaluating the logic function using the previously saved values for all storage nodes and external inputs. The logic function is evaluated at each point where one of the inputs to the logic cone changes. This is done as part of the design debug software. For example, in Fig. 20d, probed signal E can be calculated by extracting its combinational logic cone which terminates at storage elements B, C, D and design input A. The equation for signal E is evaluated whenever signals A, B, C, D change. A waveform for signal E can then be displayed exactly as if a physical probe were placed on it. This full visibility greatly speeds up debugging for complex design problems. Full visibility can also be available at a higher frequency if the number of flip-flops per logic chip 10 or 204 is limited.

At higher speeds, i.e., speeds higher than 0.5 MHZ, the user must specify which signals to probe. However, because each logic board 200 has its own logic analyzer memories 210, changing the signal being probed is fast. The reason for this is that probes do not need to be routed over the backplane, as in prior art emulation systems.

Referring again to Fig 20b, inside each logic chip 10 or 204, an additional logic circuit 2000 is added to the user's design which is programmed into logic chips 10 or 204. If a custom designed logic chip is used, this logic circuit 2000 could be designed (i.e., hard- wired) into the chip. A number of dedicated scan registers are added depending on the number of signals to be probed. The maximum depth of the scan registers is determined according to the table above. Each dedicated scan register is also known as a scan chain. Disposed between each scan flip-flop 2004 is a two-to-one multiplexer 2005. The output of each multiplexer 2005 feeds the input D of the scan flip-flop 2004 which follows it. The first input to each multiplexer 2005 is provided by a node in the user's design. The second input to each multiplexer 2005 is provided by the output Q of the preceding scan flip-flop 2004. The select input to the multiplexers 2005 is trace clock 2002, the function of which is discussed below. The scan flip-flops 2004 are clocked by the Mux Clock Signal 44. Together, a series of scan flip-flops 2004 and multiplexers 2005 form a scan register or scan chain. Depending on the length of scan chains and the number of signals to be probed, each logic chip 10 or 204 will have zero, one, or a plurality of scan chains. The number of scan chains in a given chip depends on the number of flip-flops or signals to be probed. As explained later, the software will assign signals to scan chains to minimize the number of chains and simplify the chip routing. In a preferred embodiment, a maximum of twelve scan chains and twelve input/output pins per logic chip 10 or 204 are required in order to probe all flip-flops or latches in an emulated design. To achieve the fastest possible logic analyzer operating speed, the scan chains and SGRAMs 210 operate at twice the time-multiplexing frequency. A bit of data is output on each scan output pin 2006 for every cycle of the time-multiplexing clock.

Referring now to FIG 20c, logic analyzer events are also distributed on the logic boards 200. This avoids the need to route design signals contributing to events over the backplane 800 or 802. Events are detected using additional dedicated logic 2000 inserted into each logic chip 10 or 204 on the logic boards 200.

Signals contributing to events are latched by the same scan flip-flops 2004 used for logic analyzer data and previously shown in Fig. 20b. These signals are then routed to JTAG programmable edge detectors comprising CLB memories 2018 (CLB memory is memory available on the logic chips 10, 204) which are then AND'ed together using wide edge decoder 2012 to form eight event signals. The eight event signals inside each logic chip 10, 204 are combined two to a pin using multiplexer 2020 and output to the emulation board as event signals 236 (also shown in Fig. 20a) where they are again AND'ed with the event signals from other FPGAs. The board level event signals are transmitted over the backplane to the control board where they are AND'ed with event signals from other emulation boards and other boxes. The resulting system wide event signals go the trigger logic chip 674 on the control board where they are used to generate an acquisition enable and other logic analyzer control signals.

Signals contributing to events may be defined by the user of the emulation system before compilation by filling out a form that is displayed to the user prior on the workstation connected to the emulation system. If this is done, sufficient configurable logic blocks (CLBs) in the logic chips 10, 204 (CLBs are the logical building blocks used to implement functionality in logic chips 10, 204) will be reserved during the compilation process to allow all the necessary event logic to fit. Any number of signals can be predefined with only a minimal impact on capacity (approximately four CLBs per signal). New signals can also be added after the full compile is complete. This will require an incremental recompilation and redownload to create additional edge detectors and route the new signals. Once all signals contributing to events have been defined, the user has total flexibility to change event conditions on the fly while the emulation is running. Breakpoints, trigger conditions and conditional acquisition conditions can be modified and the logic analyzer restarted without stopping the emulation. This is made possible by using JTAG programming to set up the event logic.

Fig. 20c shows an logic chip 10 or 204 with all the event and scan logic inserted. The design is divided into scan registers comprised of scan flip-flops 2004 and multiplexers 2005, event register comprised of flip-flops 2010, a JTAG interface 2016 and 2014, a set of edge detectors 2018 and wide edge decoder 2012.

Event signals cannot be saved in the scan flip-flops 2004 because the contents change as the logic analyzer data is shifted out. Thus, event flip-flops 2010 are used to remember the current and previous state for all signals contributing to events. The event register 2010 is clocked once on the next scan clock after the scan register 2004 has been loaded by Trace Clock Signal 2002 (discussed below). Alternatively, the scan register 2004 could be a parallel shadow register and tristate buffers could be used to load the scan data onto the scan output pins.

Outputs from the event flip-flops 2010 are used as inputs to the edge detectors 2018. Edge detectors 2018 are comprised of dual port CLB memories. Each CLB memory is loaded to perform the desired level/edge detection for two input signals and produces one event output. The outputs from all the CLB memories belonging to one event are AND'ed together using the built-in wide decoders 2012 to form one event signal for this logic chip 10. Event signals are then combined using a multiplexer 2020 and output to a tristate buffer 2022 at the I/O pin. Every time a user signal is needed for any event, it is attached to all eight events so event definitions can be changed at run time.

The CLB memory used in edge detector 2018 is programmed over the JTAG bus. This is done with a counter 2016 and decoder 2014 by using the dual port memory feature of the preferred embodiment logic chip 10, 204. For large numbers of event circuits, creating and routing select signals from decoder 2014 can take a significant fraction of the logic chip 10 gate capacity. As an alternative, a shift register can be created containing all edge detector memories 2018. This alternative, however, prevents random access.

Each signal contributing to an event requires approximately four CLBs plus a small amount of overhead for the JTAG interface. It is assumed that whenever a signal is added, the necessary logic is inserted to allow it to be used as part of any or all of the eight events.

If the user specified exactly which event the signal was to be used for, only one-half of a

CLB would be required, but this would significantly restrict the ability to make changes to event conditions while the emulation was running.

The edge detection memory 2018 for each signal/event combination is programmed to detect one of the following conditions: Event Conditions

Equation Mnemonic Description

A=0 0 0 Level

A=l 1 1 Level

A=0 & B=l F Falling Edge

A=l & B=0 R Rising Edge

A xor B E Any Edge

A-0 & B=0 SO Stable at a 0

A=l & B=l SI Stable at a 1

A xnor B S Stable at a 1 or 0

0 - Don't use signal

A logic analyzer cycle starts with the Trace Clock Signal 2002. Trace Clock 2002 is not a tightly controlled signal. It is only guaranteed valid at the rising edge of the Mux Clock Signal (MUXCLK) 44. Trace Clock 2002 causes a synchronous sample of data to be saved in all the scan chains. It also starts the event computation. The board level events are sent to the control module 600 where they are AND'ed together and used to control the trigger generator state machine 674. After several trace clock periods, the trigger generator produces an Acquire Enable signal 238 that controls writing of data to the SGRAM 210 on logic boards 200. The circuit then remains inactive until the next Trace Clock 2002.

Logic analyzer data is stored in RAMs on each emulation board. As stated earlier, each logic board 200 contains fifty-four mux chips 12, each of which has eight pins connected to an SGRAM 210. Thus, there are 54*8 = 432 data channels in the RAM. Logic analyzer data is stored in basic units called frames. A frame is generated following each trace clock 2002 and consists of all the data shifted out once from the logic chip 10 or 204 scan chains. A frame may fill from two to sixty-four RAM locations and take two to sixty-four Mux Clock signal (MUXCLK) cycles to generate. A typical frame looks as follows:

Data Channels (432 Frame 0 Data O

Data l

Data 2

Data 3

Frame 1 Data 0 Data 1

Data 2 Data 3

A minimal frame would take only two RAM locations. Frame length is always a multiple of two. Therefore, legal lengths are two, four, eight, ... sixty-four RAM locations. To meet the SGRAM 210 timing requirements, sequential writes within a frame are done into opposite banks of the memory. For the minimum size frame, one word of data is stored in the low RAM bank and one word in the high RAM bank.

Logic board memory is 512K words deep. The memory is divided equally into thirty-two self-contained blocks, each of which has 8192 words and may include between 4096 and 128 frames depending on the frame length. Blocks are fixed length and always start on 8K word boundaries. Within a block, frames may be stored in random order but there is no overlap of frames between blocks. All frames from a later block will have a higher timestamp value than all frames from an earlier block.

The depth of logic board memory 210 is dependent on the designers choice and the depth of memory chips available. Deeper memories may be used in the future as larger SGRAMs become available.

A timestamp value is saved in a clock RAM 612 (shown in Fig. 19) on the control board 600 each time a frame is saved on the logic boards 200.

The logic analyzer supports a conditional acquisition option. This means that individual frames may or may not be written into memory depending on the value of one of the event signals and or the current state of the trigger state machine. Conditional acquisition allows more efficient use of the memory since only significant data is saved. Conditional acquisition is controlled by an Acquire Enable Signal 238 generated on the control board 600. There is a pipeline delay of approximately seven trace clocks after a trace clock 2002 to generate the Acquire Enable Signal.

Because of the delayed Acquire Enable Signal, it is not possible to determine at the time data is available whether it is supposed to be saved or not. Data is, therefore, always saved into memory and overwritten later if the delayed Acquire Enable Signal shows that it was not good. This results in the data being saved into memory in essentially random order. The correct data order is recovered after the logic analyzer stops by sorting the timestamps saved in clock RAM 612 and distributing a set of pointers to each logic board processor 206. The pointers show the physical memory location of each sequential data sample. The out-of-order data is limited to one block of the memory because it is necessary to handle wraparound of the memory address counter. The oldest block of data must be discarded as soon as the address counter writes again into the first location of the block.

The logic analyzer control logic chip 674 on the control board also has a Block Register in which five bits of data are saved after each block is written (one-hundred sixty bits total). Four of these bits are the value of the Acquire Enable Signal for each of the last four frames written. One extra bit specifies whether the block was written in sorted order.

This is equivalent to saying that Acquire Enable was valid for each trace clock during the block.

To force blocks not to overlap, the last four frames in each block will always be written, regardless of the state of the Acquire Enable Signal. These last four frames may or may not contain good data. The control module processor examines the corresponding Acquire Enable bits in the Block Register to see whether the data is good or not. The number of actual data frames in a block may, therefore, vary by four.

This needs to be taken into account when creating the set of pointers for the emulation boards. The last four words of data saved before the logic analyzer stops also may or may not contain good data. This can be determined by flushing the Acquire Enable pipeline into the Block Register after the logic analyzer stops. The control module processor 700 is able to read the address of the last frame stored before the logic analyzer was stopped from logic analyzer control chip 674. This is used to determine the last data block written. The first data block is either block 0 if the address counter did not overrun or the next higher block. One additional status bit is necessary which is set when the address counter overruns for the first time. The last data block being written when the logic analyzer stopped will probably contain some old frames written during the previous wrap-around of the address counter. These must be discarded. The frames to be discarded can be determined by sorting with the timestamp value and discarding any frames that have a timestamp earlier than the earliest timestamp in the first data block. For example, assume that the frame length was one (instead of two to sixty-four) , there were eight frames per block (instead of 4096) and the memory had a depth of twenty- four (instead of 262,144). The logic board and control board memories might have the following data after the logic analyzer stopped: Logic Board Control Board Block Register

Address Data Memorv Timestamp Sorted Acq.

Enable

0 28 43 0 0111

1 18 47

2 <- Counter 17 45

3 92 4

4 93 5

5 94 6

6 95 7

7 96 8

8 3 13 0 0101

9 1 10

10 2 12

11 5 27

12 7 29

13 14 30

14 8 31

15 27 32

16 3 33- 1 0111

17 9 34

18 10 35

19 11 37

20 12 39

21 13 40

22 14 41

23 17 42

Address Overflow Bit = 1 The address counter stopped at location 2 and the Address Overflow bit is set. This means that the block from location 0 to 7 is the last block and the block from location 8 to 15 is the first block. By looking at the Acquire Enable bits stored for the first block, it can be determined that the frames at the end of the first block at locations 12 and 14 are good and the frames at the end of the first block at locations 13 and 15 are bad. All other frames in the block are good, otherwise the address counter would not have incremented to the next block. After sorting by timestamp and removing the bad data, the first block is:

Emulation Board Control Board Address Data Memory Timestamp 9 1 10

10 2 12 8 3 13

11 5 27

12 7 29 14 8 31

Note: The last four frames in a block will always be in sorted order so bad frames may be removed either before or after sorting by the timestamp.

The second block is processed next. The frame at address 23 is bad in the second block starting at address 16. The block does not need to be sorted because the Sorted bit for this block is set in the Block Register. After removing the bad frame, the block looks like:

Emulation Board Control Bo

Address Data Memorv Timestamp

16 3 33

17 9 34

18 10 35

19 11 37

20 12 39 21 13 40

22 14 41

The last block, starting at address 0 is now processed. First the frame is sorted by timestamp to g ive:

Emulation Board Control Board

Address Data Memory Timestamp

3 92 4

4 93 5

5 94 6

6 95 7

7 96 8

0 28 43

2 17 45

1 18 47

Next, all frames with timestamps earlier than the first timestamp, in the first block (10) are discarded. This leaves only three frames in the block.

Emulation Board Control Board Address Data Memory Timestamp

0 28 43 2 17 45

1 18 47

The Block Register Acquire Enable bits for the last frame contain the last values from the Acquire Enable pipeline. The register contents for this block are 0111. This means that the last frame at address 1 is bad and the other two frames at address 0 and 2 are good. The low order bit is meaningless since only three frames have been written to this block. The last block then looks like: Emulation Board Control Board

Address Data Memory Timestamp

0 28 43

2 17 45

and the complete set of recovered data is:

Emulation Board Control Board

Address Data Memorv Timestamp

9 1 10

10 2 12

8 3 13

11 5 27

12 7 29

14 8 31

16 3 33

17 9 34

18 10 35

19 11 37

20 12 39

21 13 40

22 14 41

0 28 43

2 17 45

The software required to program the preferred embodiment system will now be discussed. The software is updated from, and therefore different than the software previously disclosed in United States Patent Nos. 5,109,353., 5,036,473, 5,448,496 and 5,452,231 and 5,475,830, the disclosures of which are all incorporated herein by reference. A flow diagram is shown in Fig. 21.

The source netlist could be directly imported by the netlist importer 1000, produced by a logic synthesis program 1002 such as HDL-ICE™ brand logic synthesis software available from Quickturn Design Systems, Inc., or generated by behavioral testbench compiler 1004. Netlist importer 1000 is capable of taking gate level text netlists in a variety of formats such as EDIF and Verilog and converting the netlists into an internal database netlist format which is represented by database logical libraries that contain hierarchically defined cells, generic cells, and special hardware cells. Special hardware cells include memory specification cells, microprocessor cells, and component adaptor cells. Some of the hierarchically defined cells have a flag that prevents them from being flattened and split among several logic chips 10 to avoid timing problems when routing between chips. The choice and design of netlist import software is a matter of design choice and will not be discussed further. As discussed, a flattened cell is one which contains no hierarchical cells. It only contains the most primitive components such as simple logic gates.

HDL-ICE™ brand logic synthesizer 1002, which is the presently preferred logic synthesizer 1002, takes register-transfer-level (RTL) Verilog or VHDL netlists and converts them through a logic synthesis process into the database format used by the netlist importer and other compilation steps. Other suitable synthesis products are commercially available from Synopsis Corporation and others, although the HDL-ICE™ brand logic synthesizer has some advantages such as better integration and higher operating speed.

Behavioral testbench compiler 1004 allows behavioral testbenches described in Verilog or VHDL to be emulated. Code executing in parallel on processors 206 of one or more logic boards 200 is tightly coupled through co-simulation logic chip 204 to other logic which may come through netlist import program 1000 or HDL-ICE™ brand logic synthesizer. Code executing on processors 206 may be a behavioral (non-synthesizable) representation of a logic design while other logic is in a gate level, (synthesizable) RTL representation.

Logic cell memory (LCM) generator 1006 replaces memory specification cells from the user's design that will be implemented using memories built into the logic chips 10, with hierarchically defined cells (hard macros) that define memory cell implementation including, possibly, the mapping to configurable logic blocks within the logic chips 10 and their relative location inside each logic chip 10.

User data input program 1008 allows the user to enter information necessary for the design compilation, such as clock information, probe information, special net information, etc. This information aids the emulation system in handling certain conditions that can cause problems during the emulation if not handled in a special manner.

Data qualification program 1010 verifies correctness of the netlist and user data. It finds common netlist errors such as undriven inputs or multiple outputs attached to a net.

Clock tree extraction program 1012 extracts the clock tree from hierarchical netlist and identifies clock terminals on all levels of design hierarchy. A description of the operation of this step is disclosed in detail in United States Patent No. 5,475,830.

Hierarchical partition planning program (HPP) 1014 is used for the physical module chip partitioning algorithm. It identifies the portions of the design to be mapped to each logic board 200.

Partition DB setup 1016 prepares the database for parallel execution of the chip partitioning program for each portion identified by HPP 1014.

_*

Chip partitioning program 1018 identifies the clusters of logic to be implemented in each separate logic chip 10.

NGD Out program 1020 creates NGD files corresponding to each chip based on the results of chip partitioning. NGD is a file format common to various software programs available from Xilinx Corporation. NGD files contain logic and routing information necessary to implement a logic design into logic chip. As discussed, in the presently preferred embodiment, logic chips from Xilinx are utilized. The NGD Out program 1020 translates database information into the NGD format. NGD Out program 1020 also starts parallel partition, place and route (PPR) jobs 1022 for the individual logic chips 10 with an arbitrary input/output pin assignment. PPR program 1022 is a program commercially available from Xilinx Corporation which produces programming files for the FPGAs Xilinx manufactures.

Physical DB Generation program 1026 prepares the physical database to be used by board partitioning program. The physical database contains information about the physical connections between logic chips 10 and Mux chips 12 for each board in the system.

Board partitioning program 1028 identifies the placement of logic gates into logic chips 10 within each pair of logic boards 200. It considers the limitations on memory instances that can be implemented on each logic board 200, the logic analyzer probe channels limitation, the one microprocessor per board limitation as well as backplane and turbo connector limitations.

EBM compilation program 1030 combines all remaining memory specification cells assigned to the same logic board 200 into no more than twelve groups corresponding to the RAMs 208 (previously shown on Fig. 11). The input/output signals that connect to SRAM chips 208 are marked with corresponding pin numbers. System routing module 1032 selects the physical nets and time-division multiplexing (TDM) phases to implement logical nets that cross the chip boundaries. It assigns pin numbers and TDM phases to all chip input/output pins. It also produces the programming data for Mux chips 12 and repeater pods 520.

NGD update program 1034 starts final incremental PPR jobs 1036 for each logic chip 10 providing the final connectivity of TDM logic and input/output assignment. When the jobs are successfully completed, the compilation is finished.

Details of the functionality of the various programs will now be described further.

Referring to Fig. 22, the sequence of steps necessary for the compilation of a software-hardware model created by behavioral testbench compiler 1004 is shown. Compilation starts from the user's source code in Verilog or VHDL. As a result of an import process 1100, the behavioral database representation 1102 is created. After model compilation is finished, it results in a logic representation of an emulation model 1114 and a set of executables 1112 downloadable into logic module processor DRAMs 226 previously shown on Fig. 20. The behavioral testbench compiler software 1004 includes four executables and a runtime support library.

The importer 1100 processes the user's Verilog or VHDL source files and produces a behavioral database library 1102. It accepts a list of source file names and locations and file names for libraries where the otherwise undefined module references are resolved. The source file names are the file names used by Verilog or VHDL.

The preprocessor 1104 transforms the behavioral database library 1102 created by importer 1100 into a new behavioral database library 1106. It performs partitioning of the behavioral code into clusters (also referred to as partitions) directed for an execution on each of the available processors 206 (see Fig. 11) and determines the execution order of the code fragments, and the locality of variables in the partitions. Code fragments are independent pieces of code which can be executed in parallel on processors 206. Also, the preprocessor does all the transformations necessary for creation of hold time violation free model. See, for example, United States Patent No. 5,259,006 to Price et al, the disclosure of which is hereby incorporated by reference in its entirety.

The code generator 1110 reads the behavioral database library 1106 as transformed by the preprocessor 1104 and produces downloadable executables for each of the clusters identified by the preprocessor 1104. These executables will be downloaded into DRAMs 226 for execution on processors 206. The netlist generator 1108 reads the behavioral database library as transformed by the preprocessor 1104 and produces a logical database library 1114 for further processing by the other compiler programs 1006-1036. To represent special connections of the co- simulation logic chip 204 to the microprocessor bus and event synchronization bus (see Fig. 11), the netlist generator 1108 will create the netlist structure shown in Fig. 23. MP Cell 1200 is a special cell corresponding to processor 206 which will not be clustered by chip partitioning program 1018 (similar to the LBM cell instances). Peripheral controller cell 1202 is a regular cell that contains library component instances and will be placed into co-simulation logic chip 204. Only a minimal amount of logic will be placed into this cell 1202 that directly interacts with the microprocessor bus. Placing minimal amounts of logic into the peripheral controller cell 1202 prevents the need for wait state programming. Peripheral controller cell 1202 will be flagged to prevent chip partitioning program 1018 from splitting it among several logic chips 10. It is a responsibility of netlist generator 1108 to make sure that the capacity of this cell does not exceed the capacity of a single logic chip 204 and that the number of connections between this cell and the rest of the netlist does not exceed the number of connections between co-simulation logic chip 204 and Mux chips 12. As discussed previously, co-simulation logic chip 204 has three pins electrically communicating with each of fifty-four Mux chips 12. This means that one hundred sixty-two connections are available between the co-simulation logic chip 204 and the Mux chips 12 (3*54 = 162) as shown in Fig. 11. Netlist generator 1108 will also mark special nets that connect to the MP cell 1200 with the corresponding pin numbers that will guide system router 1032 to generate correct physical connections for co-simulation logic chip 204. This is required because connections between processor 206 and co-simulation logic chip 204 are attached to specific pins of logic chip 204. Behavioral testbench compiler 1004 has been fully disclosed in a co-pending application: Method And Apparatus For Design Verification Using Emulation And Simulation, serial number 08/733,352 by Sample et al. which is incorporated herein by reference in its entirety.

Logic Chip Memory (LCM) generator 1006 implements shallow but highly ported memories using Xilinx relationally placed macros (rpms). It supports memories with up to fourteen write ports, any number of read ports, and one additional read- write port for debug access. It utilizes synchronous dual-port RAM primitives which are available as components of the logic chip 10.

Fig. 22a shows an example of a memory circuit that could be generated by LCM memory generator 1006 for placement in a logic chip 10. The memory circuit in Fig. 22a comprises the following components:

A write enable sampler and arbitrator 1050 synchronizes write enable signals with a fast clock and prioritizes the write operations of the memory circuit when there are requests from several ports at once. The write enable sampler and arbitrator 1050 outputs write address/data mux selects and write enable signals. Write enable sampler and arbitrator cells are pre-compiled into a reference library in the form of hard macros with various different write port configurations from two to sixteen write ports.

The memory circuit of Fig. 22a also comprises a read counter 1052. Read counter 1052 is used to cycle through the read ports of the memory to be implemented. These counters are also pre-compiled into a reference library as hard macro cells with various count lengths.

The memory circuit of Fig. 22a also comprises a multiplexer 1053 which places either the output of the read counter 1052 or the write enable sampler and arbitrator 1050 on its output. The output of multiplexer 1053 is the slot select signal SLOT SEL, which comprises four wires allowing any one of sixteen slots (or ports) to be selected.

The memory circuit of Fig. 22a also comprises address muxes and data muxes 1056. Address muxes and data muxes 1056 are used to select port write/read address data and port write data when the appropriate slot or port time arrives. The slot select signal SLOT_SEL is input to the select inputs of the address muxes and data muxes 1056 to perform this function.

The memory circuit of Fig. 22a also comprises memory 1058. Memory 1058 is a static RAM memory available as a one or more Xilinx configurable logic block (CLB) components. The memory circuit of Fig. 22a also comprises read slot decoder 1054. Read slot decoder 1054 decodes the slot select signal SLOTJSEL (of which there are four) into up to sixteen individual wires to be used as the clock enable inputs for the output registers 1060.

Referring back to Fig. 21, the width, depth and number of ports generated by LCM memory generation program 1006 depends on the requirements of the netlists produced by netlist import program 1000, HDL-ICE™ brand synthesizer program 1002 or Behavioral Testbench program 1004. The Xilinx relationally placed macros (RPMS) are created as a database cells defined using generic cell instances, as well as instances of special FMAP and HMAP cells to control the mapping of the memory circuits into the particular logic modules of the logic chips 10. FMAP and HMAP cells are special primitive components which control the behavior of the Xilinx PPR program 1022. As discussed, in the presently preferred embodiment, these are the CLBs in the Xilinx FPGAs. These instances can also have an RLOC property that specifies relative location of a logic module (a CLB in the presently preferred embodiment) where the logic is to be placed. The RPM cells must be flagged (in the presently preferred embodiment, this flag is referred to as "NOFLAT") to prevent the chip partitioning program 1018 from splitting them between several logic chips. The RPM cells must also have precalculated capacity values and a property containing their dimensions (number of logic modules, e.g., CLBs, used horizontally and vertically). Data qualification program 1010 does not verify the netlist inside RPM cells because parallel connection of FMAP and HMAP primitives to the logic primitives may create an appearance of design rule violation. The NGD Out program 1020 will preserve RLOC values in all primitives in each RPM instance. This will allow PPR 1022 to place RPMs in a chip in such a manner as to satisfy the constraints defined by RLOC properties. User data input program 1008, in addition to allowing the user to enter clock and other design information, also computes the global probe multiplexing factor. Probes are the points inside a netlist which will be observed during debugging of the design. The probe multiplexing factor determines the length of scan chains which will be added to the logic chips 10. The user can either list the probes or request a full visibility mode. In the case of full visibility, the multiplexing factor is sixty-four. If the user wants only a specified list of signals to be visible, then the multiplexing factor should be computed as:

(Number of probes) * (Deviation factor) / (432 * (Number of logic boards))

The number of logic boards 200 must be known when the computation is made. Deviation factor is an experimentally deteπnined factor used to account for possible non-uniform distribution of probed signals among logic boards 200. Probability theory considerations suggest a value between 1.4 for large systems and 1.7 for two-board systems. For a system with B boards it is approximately l/(l-0.29sqrt(B/(B-l))). This factor can be further increased to provide the room for adding probes incrementally without recompilation of more than one logic board 200.

Logic analyzer events in the preferred embodiment system are computed by the programmable logic in the logic chips 10 on logic boards 200. Therefore, capacity should be reserved in logic chips 10 for event calculations. Consequently, if the user delays signal and event definition until after the design compilation, the incremental recompile of affected chips will be necessary. In the case when the reserved capacity is insufficient for a given chip, signals will need to be routed to other logic chips 10 that have sufficient capacity to build an event detector, as previously shown in Fig. 20c. This can result in a longer compilation time. A long compilation time can be avoided by specifying all signals before compilation that are used to create any event. It is unnecessary to actually define events or triggers at this point because this has no effect on capacity. The event logic function itself can be downloaded into the logic chip 10 during its operation using the JTAG bus connected to controller 221 (shown in Fig. 20 and 20c). Finally, during this user data input step 1008, the user needs to select the time- multiplexing factor for non-critical signals. As discussed above, the time-multiplexing factor can be either one, two, or four.

Chip partitioning programs 1016 and 1018 use a clustering based algorithm. Examples of similar algorithms can be seen in prior art hardware emulation systems such as the System Realizer™ emulation system from Quickturn Design Systems, Inc. In the presently preferred embodiment, however, there are a number of differences. These differences will now be explained in detail.

1) Certain types of cells need special attention to avoid improper partitioning, clustering, etc. "No-touch" cells are certain cells which must not be clustered together with any logic. An example of a "No-touch" cell is the MP cell shown in Fig. 23. "No- flat" cells are cells which must not be split among several chips. Examples of "No-flat" cells are latches and hard macros where splitting would introduce timing problems.

2) Some special nets do not have drivers and can be cut arbitrarily. In addition to POWER and GROUND, an example of such a special net to which logic gates can be connected is the Mux Clock signal (MUXCLK) 44. In particular, the behavioral testbench compiler 1004 and the EBM compiler 1030 and LCM compiler 1006 will create logic connected to MUXCLK.

3) Pin out constraints control the maximum number of nets that a cluster can have. Assuming that a cluster of logic has RI regular external input nets, RO regular external output nets, CN critical external nets, P probed signals, and the time-division multiplexing factor for probes is T, the number of pins required to implement this cluster on a chip is calculated as follows (all divide operations are pure integer divisions without rounding). a. Without time-multiplexing of logic signals, the number of pins is RI + RO + CN + (P+T-l)/T; b. With two-to-one time-multiplexing of logic signals, the number of pins is (RI+l)/2 + (RO+l)/2 + CN + (P+T-l)/T c. With four-to-one time-multiplexing of logic signals, the number of pins is max((RI+l)/2 , (RO+l)/2) + CN + (P+T-l)/T Note: when full visibility mode is selected by the user, the number of probes P is assumed equal to the number of flip/flops and latches.

4) The maximum size allowed for a cluster is based upon the gate capacity of the particular logic chip 10. In addition to logic gates, additional capacity is required for time- division multiplexing, probing and event detection circuitry. Assuming that a cluster of logic has RN regular (non-critical) external nets (RN is equal to RI plus RO), P probed signals, and E signals used in event detection then the added capacity for time-division multiplexing, probing, and event detection circuitry is as follows: a. Without time-multiplexing of logic signals the additional capacity for logic analyzer is flip/flops: P + 2*E + logE gates: *P + C₂*((E+l)/2)*8

In the presently preferred embodiment, the constants are 0^2, C₂=4. They may be adjusted later based on experimental results. b. With any type of time-multiplexing (2:1, 4:1, or other schemes), an additional RN flip/flops is needed in addition to those required for the logic analyzer. 5) Partitioning is also controlled by the need to implement the clock tree correctly as explained in United States Patent No. 5,475,830. Each net in the design is assigned a 16- bit integer property which is called CLKMASK. Bit i of CLKMASK should be set if user clock i reaches this net in a direct (non-inverted) phase. Bit 8+t should be set if user clock i reaches this net in an inverted phase. This information will be passed to the PPR program 1022 to perform the required delay adjustment.

The NGD Out program 1020 outputs a netlist in a format suitable for the PPR program 1022 to process. In addition, it performs a number of special functions relating to logic modification to insert time-division multiplexing or debugging logic. These functions are:

• Relationally placed (RP) macro preservation: Relationally placed macros in the database are preserved in the NGD files passed to PPR. RP macros are groups of logic gates that have been mapped into fixed patterns of CLBs inside the Xilinx

FPGAs. RP macros will not be re-partitioned in later software steps so as to preserve their timing characteristics.

• TDM cells insertion: Time-division-multiplexing cells are added to the boundary of each logic chip 10 where it connects to a Mux chip 12. Predefined cells are used which are placed relative to the set of input/output pins being multiplexed. Figs. 24a-24k show all the different varieties of TDM cells which may be inserted depending on the type of the input/output pins. For time-division multiplexing, the terminals of a logic chip 10 and Mux chip 12 are divided into groups of four using the special RPM cells as shown in Fig. 24a-24k. For the remainder of the terminals, groups of two are used, or the regular non-multiplexed input/output already on the logic chip 10 or Mux chip 12 is used. Non-multiplexed input/output is always used for critical nets.

• TDM control logic insertion: TDM control logic generates and distributes the TDM control signals, which are MC, MS, MT, E0, El, E2, and E3, into the circuits shown in Fig. 24a-24k. These signals are generated by one of three special control cells which are inserted into each logic chip 10 in addition to the logic shown in Fig. 24a-24k. Generation of these signals is done using logic 104 in shown Fig.6 or logic 68 shown in Fig. 3. MC is Mux Clock Signal 44; MS is Divided Clock Signal 50; MT is Direction Signal 80; and E0-E3 are the Enable

Signals 90, 92, 94 and 96, respectively. The special cells have two inputs MUXCLK 44 and SYNC- 48 which are connected to fixed input pins on logic chip 10. One type of control cell (not shown) is used for the chips that do not use TDM but have logic connected to Mux Clock Signal (MUXCLK) 44. This cell only outputs Mux Clock Signal (MUXCLK) 44. The second type (logic 68 shown in

Fig. 3) is used for designs with two-to-one TDM. It outputs Mux Clock Signal (MUXCLK) 44 and MS (Divided Clock) signals 50. The third type of control cell (logic 104 shown in Fig. 6) is used for four-to-one time-multiplexing. It generates Mux Clock Signal (MUXCLK) 44, MS (Divided Clock) 50, MT (Direction) 80, E0 90, El 92, E2 94, E3 96.

Scan cell insertion for probed signals: Each probed signal must be connected to the data input of a probe cell. The probe cell has no outputs and two other inputs. One of these inputs is electrically connected to Mux Clock Signal (MUXCLK) 44. The other input is electrically connected to the Trace Clock Signal 2002 coming from a chip input. Probe cells comprise a flip-flop 2004 and a multiplexer 2005, as seen in Figs. 20b and 20c.

• Generation of scan chain specification file: All instances of probe cells must be listed in a scan chain specification file. The scan outputs 2006 (see Fig. 20b) of the chip must also be listed. These outputs must are inserted into a database model of chip logic clusters so that the system router can see them and build appropriate connections. The number of outputs is (P+T-l)/T where P is the number of probe cells and T is a time-division multiplexing factor for probe signals.

• Insertion of event detection cells for signals contributing to events: The signals contributing to events are divided in pairs and each pair is connected to the 10 and II inputs of eight copies of an event detection cell 1300, as shown in Fig. 25. A preferred embodiment of an event detection cell has been previously shown in Fig. 20c. The event detection cell 1300 comprises four flip-flops 2010 and a CLB memory 2018. Four multiplexers 2020 and four output buffers 2022 are used to produce four multiplexed event signals 236 (also shown in Figs. 20c and 20a). If the number of signals is odd, one of the inputs to each of the event detection cells is left unused for the corresponding eight cells.

• Generation of eight balanced AND trees for event detector outputs, and the TDM logic to connect the eight AND trees' outputs to four dedicated event pins:

The outputs of event detection cells 1300 are combined using eight balanced AND trees so that one copy of the eight cells created in the previous step is present in each of the trees. The outputs of the trees are time-multiplexed pairwise using special event-multiplexing cells as shown in Fig. 26. This circuitry has also been described in reference to Fig. 20c. AND gates 2012 are constructed using wide edge decoders 2012 as shown in Fig. 20c. Fig. 26 shows this circuitry in greater detail.

• Generation of event detector download paths and a boundary scan controller: Event detector download circuit 1500 is shown in Fig. 27. It is comprised of a counter 2016 and shift register 2014, together with JTAG controller

1150. JTAG controller 1150 is available as a standard portion of the Xilinx logic chips 10. This circuitry is also shown together with the scan register and event detector in Fig. 20c. The event detector download circuit 1500 produces the WA 1502, WE 1504, DRCLK 1508, and TDI 1506 signals for all event detectors (also shown in Fig. 20c). The event detector counter 2016 generates WA signals 1502 and a clock for shift register 2014, the length of which depends on the number of event decoder circuits. The circuit is shown in Figs. 20c and 27. In a preferred embodiment, shift register 2014 is generated based on the number of event detectors. It is acceptable, however, to define a maximum number of event detectors per chip and fix the design of the shift register 2014. The PPR program

1022 will trim most of the unused logic.

Referring back to Fig. 21, board partitioning step 1024 will now be discussed. The function of board partitioning step 1024 is to find chip clusters (a cluster is a collection of interconnected components) with the largest possible number of chips not exceeding the number of logic chips 10, 204 on a single logic board 200 (thirty-seven chips) or a pair of logic boards (seventy-four chips), with the following limitations:

1. Total number of ingoing or outgoing nets should not exceed the sum of the input/output connections on two backplane connectors 220 for a pair of logic boards 200 as shown in Fig. 11 (3608 in the presently preferred embodiment) multiplied by a target backplane utilization coefficient. The target backplane utilization coefficient is determined experimentally, and depends on the success the system routing program 1032 is able, on average, to achieve. The target backplane utilization coefficient is expected to be approximately ninety percent.

2. The total number of chip outputs marked as logic analyzer channels should not exceed 864 (fifty-four Mux chips 12, multiplied by eight SGRAM 210 pins, the total of which is multiplied by two logic boards 200 in a module).

3. The full set of EBM memory instances should fit into no more than twenty- four chips (twelve for a half-size modules) (as described earlier with reference to Fig. 11, there are twelve RAMs 208 on a logic board 200 or twenty-four on a pair of logic boards) and the number of logic chips 10 required for EBM memories counts against the total of seventy-four (thirty- seven for a half-size module). 4. Total number of CPU cell instances (i.e., the number of CPU instances from the user's design) should not exceed two (one for a half-size modules) (as described with reference to Fig. 11, there is one processor 206 per logic board 200 or two on a pair of logic boards). 5. Two (one for a half-size module) of the seventy-four (thirty-seven for a half-size module) chips 204 can be used as clock generation logic chips or attached to the microprocessor cells. If microprocessor cells are present, there will be no clock generation logic chips and vice versa because the CoSim logic chip 204 can only be used for one function at a time. However, it is possible that there are neither. In such case, only seventy- two (thirty-six on a single logic board 200) full-capacity logic chips 10 can be used. The two additional CoSim logic chips 204 (one for a half-size module) can then be used to implement additional user logic if clusters with no more than one hundred sixty-two input/output pins are available (see Fig. 11).

After the appropriate clusters are identified, the full-size clusters are further subdivided into two emulation boards with no more than 1868 (the number of pins on turbo connector 202) inter-board connections. Each board must have no more than half of all critical cluster resources (1804 ingoing or outgoing nets, twelve EBM memories, one microprocessor or clock generation logic chip 204, four hundred thirty-two logic analyzer channels, thirty-seven logic chips 10, 204).

EBM compilation step 1030 creates the memory cell instances to be implemented as emulation block memories (EBM). These are created as special cells not to be included in any logic clusters during chip partitioning. An estimation subroutine evaluates how many EBM chips 208 (see Fig. 11) a given set of memory instances requires. This subroutine will be called from hierarchical partition planning program (HPP) 1014 (this connection is not shown in Fig. 21) and board partitioning program 1028 to properly designate a set of memory instances that can be implemented on one board, and the number of logic chips 10 that the memory control circuit will consume. After board partitioning process 1028 is complete, the EBM memory compiler 1030 will create a logic cluster associated with each RAM chip 208 on logic board 200. All lines leading to RAM chip 208 will be marked as being "critical" so that NGD Out program 1020 will not insert time-multiplexing logic into them. They also have properties containing their respective logic chip 10 pin numbers so that system router 1032 can generate correct input/output constraints. EBM logic clusters cannot contain probe signals and cannot generate events because they contain automatically generated logic not accessible to the user.

In a preferred embodiment, the EBM logic clusters are pre-compiled. This allows the placement and routing time to be saved for these clusters. EBM memory compiler 1030 has been for fully described in co-pending application 08/733,352.

System router 1032 assigns physical wires in the logic chips 10, 204, Mux chips 12, and logic boards 200 to the logic nets (or signals in an emulated design), pairs of logic nets (in two-to-one multiplexing) and the groups of four nets (in four-to-one multiplexing). Following that, it assigns the logic chip 10 pin and a time-division multiplexing (TDM) phase to each signal going in and out of each logic chip 10 and 204.

It is important when doing system routing to select the optimal route for time- multiplexed signals to minimize the signal delay. The algorithm for doing so is as follows:

1. Two-to-one time-division multiplexing (2-1 TDM): The optimal route switches TDM phases in each Mux chip 12 but not en route from the physical net source to the physical net destination. Examples of optimal routes are: alpha/output/even-beta/input/even-beta/output/odd-alpha/input/odd, or alpha/output/even-beta/input/even-beta/output/odd-muxbeta/input/odd- muxbeta/output/evenbeta/input/even-beta/output/odd-alpha/input/odd programmable logic chips are equivalent to logic chips 10 or 204 and beta chips are equivalent to Mux chips 12 in this description. This gives a minimal one cycle delay between two logic chips 10 or 204. The delay may appear to be one- half of a cycle upon examining the logic in Figs. 3 and 4. It is, in fact, one full cycle because a demultiplexer 34 in logic chips 10, 204 clocks signals close to the end of the half cycle so that the signal is steady in logic chips 10 or 204 on the next half cycle after it is received. If router 1032 fails to find an optimal route, meaning that an appropriate phase MUX output is not available, or an appropriate phase logic chip 10 or 204 input is not available, the signal loses an additional half cycle of delay. The router attempts not to accumulate the misses along the same net, if at all possible. Critical nets are not multiplexed in order to minimize their delay. 2. Four-to-one time-division multiplexing (4-1 TDM): Each physical net always includes one inout pin (IIOO sequence) and one outin pin (OOII sequence). Again, the optimal route switches one time-division multiplexing (TDM) phase in Mux chip 12 but not en route from a physical net source to a physical net destination Examples of optimal routes are: alpha/Oinput/output 1 -beta/IO/11 -b eta/Oinput/output2- alpha/IO/2alρha/Oinρut/outρut2-beta/I0I2-beta/IO/O3- alpha OI/I3alpha/Oinput/outρutl-beta/IO/Il-beta/Oinρut/outρut2- muxbeta IO/I2-muxbeta/IO/O3- beta OI/I3-beta/IO/O4-alpha/OI/I4 This gives a minimal one-half cycle delay alpha-to-alpha. However, one- half cycle of four-to-one time-division multiplexing (4-1 TDM) has same duration as one cycle of two-to-one time-division multiplexing (2-1 TDM). Therefore, assuming all nets are optimally routed, no speed is lost in four-to-one time-division multiplexing (4-1 TDM) compared to two-to-one time-division multiplexing (2-1 TDM). However, misses (i.e., failure to find an optimal route, as discussed above) in four-to-one time-division multiplexing (4-1 TDM) routing have more severe consequences than in two-to-one time-division multiplexing (2-1 TDM) routing.

For example, the path: alpha Oinput/output 1 -beta/IO/11 -beta/Oinput/output 1 -alpha/IO/11 will delay the signal by 1.25 four-to-one time-division multiplexing (4-1 TDM) cycles (or 2.5 two-to-one time-division multiplexing (2-1 TDM) cycles) which is two and one-half times worse than an optimal delay. In every hop through a Mux chip 12, router 1032 can miss by 0, 1/4, 1/2, or 3/4 of a four-to-one time-division multiplexing (TDM) cycle depending on what input-output pair the router selects. Router 1032 makes every attempt to miss as little as possible. Thus, critical nets should not be multiplexed to minimize their delay. Some logic chips 10 or 204 have input/output nets locked to specific pins. Examples are Mux Clock signals (MUXCLK) 44, Trace Clock Signals 2002, connections between co-simulation logic chip 204 and a processor 206 (see Fig. 11), connections between memory controller logic chips 10 and RAM chips 208, event signal outputs 236, etc. These connections do not need to be routed but have to be included into logic chip 10, 204 pin constraints data.

Additional programming is also required for a clock distribution circuit (Mux chip 12) on control module 600 (shown in Fig. 19). This is a part of a clock circuit used to select no more than eight user clocks reaching each of the logic modules. NGD update program 1034 supplies final parallel partition, place and route (PPR) software 1036 with the information about the actual pin input/output assignments produced by system router 1032. For non-time-multiplexed designs this is just an assignment of signals to input/output pads. For time-multiplexed designs, TDM logic on the periphery of logic chips 10, 204 and Mux chips 12 is also added. Final parallel partition, place and route (PPR) program 1036 reruns the PPR program in an incremental mode to reroute the input/output pins at the periphery of the chip. As stated earlier, the PPR program is available from Xilinx Corporation. The rerouting changes logic chip 10, 204 configuration files previously produced at preliminary PPR step 1022 and fixes the Pin out as determined by system routing step 1032.

Turning now to Figs. 28-31, the dynamic interconnect testing methods of the present invention will be discussed. When performing the dynamic interconnect tests of the present invention, the emulation system is programmed such that programmable device input/outputs either initially receive or transmit a switching signal for a defined period of time. This switching signal may be a clocking square wave signal or a particular pattern of logical l's and 0's. The signal can either be driven in either direction or driven in alternating directions. Since each input/output pin operates independently from every other input/output pin, there are no limitations on how many input/output pins that can be tested per device. With reference to Figs. 28 and 29, a first preferred embodiment of the dynamic interconnect test will be discussed. As discussed above, a typical emulation system comprises arrays programmable logic devices interconnected by programmable interconnect devices. In the presently preferred embodiments, the programmable logic devices and the programmable interconnect devices are interconnected with a partial crossbar interconnect architecture like that shown in Fig. 1.

In one presently preferred embodiment, each programmable interconnect chip 12 input/output pin has a cell 3000 programmed into it. In the embodiment shown in Fig. 28, the programmable interconnect chips 12 cell 3000 has two input registers 3000a and 3000b and two output registers 3000c and 3000d. In this embodiment, the programmable interconnect chips 12 are temporarily programmed to configure the input and output registers 3000a-3000d as two shift registers. The present application will refer to these shift registers as "Even" and "Odd". Each "Even" and "Odd" shift register has one input register and one output register where the output of the input register is tied to the input of the output register. Thus, the first shift register comprises input register 3000a and input register 3000d. Input register 3000a has its output "Q" input to the input "D" of output register 3000d. The second shift register comprises input register 3000b and output register 3000c. Input register 3000b has its output "Q" input to the input "D" of output register 3000c. Each register 3000a-3000d is clocked by either the rising or falling edge of the MUXCLK 44, as discussed below. Each input register 3000a and 3000b also has an enable input, which is driven by the MUXTRI signal 3014. The purpose of the MUXTRI signal 3014 is discussed below.

Each programmable interconnect chip 12 cell 3000 also comprises a multiplexer 3000e and a tri-state buffer 3000f. The first data input to multiplexer 3000e, which in the presently preferred embodiment is a two-input multiplexer, is the output from output register 3000c. The second data input to multiplexer 3000e is the output from output register 3000d. The select input to multiplexer 3000e is the MUXSEL signal 3010. The output of multiplexer 3000e is input to the tri-state buffer 3000f. The tri-state input to tristate buffer 3000f is the MUXTRI signal 3014. Programmable interconnect chip 12 cell 3000 also has a pattern match circuit 3004. In a presently preferred embodiment, pattern match circuit 3004 comprises an OR gate 3004a, which has two inputs. The first input to OR gate 3004a is the output "Q" of input register 3000b. The second input to OR gate 3004a is the inverted output "Q" from input register 3000a. The output of OR gate 3004a is input into AND gate 3004b. A second input to AND gate 3004b is TRI- signal 3012. The output of AND gate 3004b is input to the latch enable input "G" of latch 3004c. The manner in which pattern match circuit 3004 functions will be discussed below.

Pins on programmable logic chip 10 have cells 3002 similar to that contained within the programmable interconnect chip 12 (cells 3000) programmed therein.

Programmable logic chip 10 cell 3002 has two input registers 3002a and 3002b and two output registers 3002c and 3002d. In this embodiment, the programmable logic chips 10 are temporarily programmed to configure the input and output registers 3002a-3002d as two shift registers. Just as in the programmable interconnect input/output pin cell 3000, the present application will refer to these shift registers as "Even" and "Odd". Each

"Even" and "Odd" shift register has one input register and one output register where the output of the input register is tied to the input of the output register. Thus, first shift register comprises input register 3002a and output register 3002d. The first shift register 3002a has its output "Q" input to the input "D" of output register 3002d. A second shift register comprises input register 3002b and output register 3002c. Input register 3002b has its output "Q" input to the input "D" of output register 3002c. Each register 3002a- 3002d is clocked by either the rising edge or falling edge of the MUXCLK 44. Each input register 3002a and 3002b also has an enable input, which is driven by the MUXTRI signal 3014. The purpose of the MUXTRI signal 3014 is discussed below. Each programmable logic chip 10 cell 3002 also comprises a multiplexer 3002e and a tri-state buffer 3002f. The first data input to multiplexer 3002e, which in the presently preferred embodiment is a two-input multiplexer, is the output from output register 3002c. The second data input to multiplexer 3002e is the output from output register 3002d. The select input to multiplexer 3002e is the MUXSEL signal 3010. The output of multiplexer 3002e is input to the tri-state buffer 3002f. The tri-state input to tristate buffer 3002f is the MUXTRI signal 3012. In the presently preferred embodiment, the MUXTRI signal 3012 is inverted prior to being put to the tri-state input of tri-state buffer 3002f. Programmable logic chip 10 cell 3002 also comprises a pattern match circuit 3006.

In a presently preferred embodiment, pattern match circuit 3006 comprises an OR gate 3006a, which has two inputs. The first input to OR gate 3006a is the output "Q" of input register 3002b. The second input to OR gate 3006a is the inverted output "Q" from input register 3002a. The output of OR gate 3006a is input into AND gate 3006b. A second input to AND gate 3006b is TRI- signal 3012. The output of AND gate 3006b is input to the latch enable input "G" of latch 3006c. The manner in which pattern match circuit 3006 functions will be discussed below.

Note that the designation of programmable chips programmable logic chip 10 and programmable interconnect chip 12 is arbitrary and is used solely for discussion purposes. Because the cells 3000 and 3002 of both the programmable logic chips and the programmable interconnect chips are programmable, chip 1 and chip 2 in Fig. 28 can be either a programmable logic chip or a programmable interconnect chip, and vis-versa. Thus, interconnections between programmable logic chip, between logic chips (if such interconnects are present), and between programmable logic chips and programmable interconnect chips can be tested.

The programmable interconnect chip 12 cell 3000 and the programmable logic chip 10 cell 3002 are defined as an "IN-OUT" pin or "OUT-IN" pin. In the embodiment illustrated in Fig. 28, the programmable interconnect chip 12 input/output pin cell 3000 is defined as the "IN-OUT" pin, while the programmable logic chip 10 input/output pin cell 3002 is defined as the "OUT-IN" pin.

Prior to starting a dynamic interconnect test, the input registers 3000a, 3000b, 3002a and 3002b and output registers 3000c, 3000d, 3002c and 3002d must be initialized to a predetermined state. In a presently preferred embodiment, each input register pair 3000a-3000b and 3002a-3002b and output register pair 3000c-3000d and 3002c-3002d is preloaded to the logic value of "1" if they are "Odd" and "0" if they are "Even". This is accomplished by setting the TRI- signal 3012 high, which places a "0" on the set and reset pins of the registers 3000a-d and 3002a-d. If a pin is initially set as a transmit pin, it is labeled as an "OUT-IN" pin. If a pin is initially set as an input pin, it is labeled as an "IN- OUT" pin. The "OUT-IN" or "IN-OUT" classification for pins determine whether the pin receives or transmits a signal upon receipt of the first MUXCLK 44 edge after the dynamic interconnect test has begun. A separate signal, called TRI- 3012 in this application, is used to synchronize the start and stop of the test. When the TRI- signal 3012 rises (see Fig. 29), the dynamic interconnect test begins. As stated previously, the two shift registers for each input/output pin have either a

"Even" or "Odd" state. Since each shift register also has an input and output register, there are four possible states for an input/output pin. These states are: 1) Output Odd, 2) Output Even, 3) Input Odd and 4) Input Even. For an "IN-OUT" pin, its state transitions begin at "Input Odd", and continues to "Input Even" to "Output Odd" to "Output Even" and can repeat while the test is running. The "OUT-IN" pin starts its state transitions at "Output Odd", and continues to "Output Even" to "Input Odd" to "Input Even" and repeats until the end of the test.

To determine if a chip's input/output pin is sampled or driven by the two input/output shift registers, "Odd" or "Even", two separate signals, MUXTRI 3014 and MUXSEL 3010, are used. As illustrated in Figs. 28-29, the MUXTRI signal 3014 enables the corresponding input registers (3000a, 3000b, 3002a, 3002b) to sample the input/output pin signal during input states while disabling the output of the shift register (by turning tristate buffer 3000f off). As also seen in Fig. 29, the MUXSEL signal 3010 toggles the output of the input/output pin between the two output registers (3000c, 3000d, 3002c, 3002d) during output states.

To enable the dynamic test of nets and connections between programmable logic chips 10 and programmable interconnect chips 12, one end of each net is programmed as an "IN-OUT" pin and the other end is programmed as an "OUT-IN" pin. When the TRI- signal 3012 rises, thereby initializing the start of the dynamic interconnect test, the "OUT- IN" pin outputs its preloaded value onto the net. The "IN-OUT" pin in that is supposed to be in electrical communication with the "OUT-IN" pin then clocks in the value of the net into its input register during the rising edge of "MUXCLK" while the "OUT-IN" switches output registers as dictated by the MUXSEL signal 3010. On the falling edge of the MUXCLK signal 44, the "IN-OUT" pin clocks in the value of the net into its other input register and switches direction to drive the net with its output registers. The term "changing direction" means that the pin changes from output mode to input mode, or vis- versa. The "OUT-IN" pin, in the meantime, finishes driving the net and changes direction to receive an input from the device configured as an "IN-OUT" pin. By changing direction, the "OUT-IN" pin becomes an "IN-OUT" pin and the "IN-OUT" pin becomes an "OUT-IN" pin. Thus, as is seen, the method by which a "1" and "0" are passed between two chips is a first embodiment of the dynamic interconnect test of the present invention.

This embodiment of the dynamic interconnect test is run for a predetermined amount of time, which may vary. The dynamic interconnect test is stopped synchronously on the falling edge of the TRI- signal 3012. The TRI- signal 3012 is input to the set inputs "S" of input registers 3000a, 3002a, the set inputs "S" of output registers 3000d and 3002d, the reset inputs "R" of input registers 3000b, 3002b, and the reset inputs "R" of output registers 3000c and 3002c. As discussed, this sets the registers to their proper initial value. By synchronously stopping the dynamic interconnect test, false errors caused by one chip expecting a value when another has stopped are prevented.

In the embodiment illustrated in Figs. 28-29, the programmable interconnect chips 12 ("chip 1") contain a pattern match circuit 3004 that detects whether the received value matches the expected value. The programmable interconnect chips 10 ("chip 2") contain a pattern match circuit 3006 that detects whether the received value matches the expected value. The incoming value is compared against the expected value. If the incoming and expected values do not match, an error flag is set for the pin. As discussed, in a presently preferred embodiment, each input register pair 3000a-3000b and 3002a-3002b and output register pair 3000c-3000d and 3002c-3002d is preloaded to the logic value of "1" if they are "Odd" and "0" if they are "Even".

Given this initialization, the manner in which the dynamic interconnect test functions will be described in view of several cycles of MUXCLK 44. First, the TRI- signal 3012 goes high. At this cycle of the MUXCLK 44, the TRI- signal 3012 is a "1", and the MUXCLK 44, MUXTRI signal 3014 and MUXSEL signal 3010 are all "0".

Because the MUXTRI signal 3014 is a "0", the tri-state buffer 3002f is enabled. Since the MUXSEL signal 3010 is low, multiplexer 3002e is placing the output of register 3002d at the input of tri-state buffer 3002f. Thus, the value stored in register 3002d is placed on the I/O pin of programmable logic chip 10. As discussed, at initialization, register 3002d stores a "1". Thus, a "1" is placed onto the 1/0 pin of the programmable logic device 10. At the end of this cycle of the MUXCLK 44, as seen in Fig. 29, the MUXCLK 44 begins to rise. When the MUXCLK 44 rises, the value on the I/O pin, a "1", is then latched into register 3000a. At the same time, the contents of register 3000b, a "0", will be latched into register 3000c. Finally, when the MUXCLK 44 rises, the contents of register 3002b, a "0" will be latched into register 3002c.

During the next clock cycle (i.e., right after the MUXCLK 44 rises), the MUXTRI signal 3014 is still a "0". However, the MUXSEL signal 3010 rises to become a "1" while the MUXTRI signal 3014 remains at "0". Because the MUXSEL signal 3010 is a "1", the multiplexer 3002e places the output on register 3002c at the input of tri-state buffer 3002f. Because the MUXTRI signal 3014 is a "0", this signal is driven to the I/O pin. Because a "0" was stored in register 3002c, a "0" is placed on the 1/0 pin. At the falling edge of the MUXCLK 44, register 3000b is enabled by the MUXTRI signal 3014 and clocked by the falling edge of the MUXCLK 44. Because of this, Register 3000b will latch in the value then at the 1/0 pin. At substantially the same time, register 3000d will latch the value from register 3000a because register 3000d is clocked on the falling edge of the MUXCLK 44. In addition, register 3002b is not enabled because the MUXTRI signal 3014 signal is at "0". At substantially the same time, register 3002d latches in the value of register 3002a, which is a "1".

Turning to the next clock cycle, as illustrated by Fig. 29, the MUXCLK 44 and the MUXSEL signal 3010 are at "0", while the MUXTRI signal 3014 has risen to a "1". Because the MUXTRI signal 3014 controls the tri-state buffers 3000f and 3002f, the MUXTRI signal 3014 controls the direction of the dynamic interconnect test. In other words, the MUXTRI signal 3014 controls whether an I/O pin is in output mode or input mode. Thus, because MUXTRI signal 3014 is now a "1" and MUXSEL signal 3010 is a "0", the signal stored in register 3000d is now driven onto I/O pin on programmable logic device 10 (which should be a "1"). At the end of this clock cycle, MUXCLK 44 rises, while MUXTRI signal 3014 remains a "1". Thus, register 3000a is not enabled. At substantially the same time, register 3000c latches the value stored by register 3000b (which should be a "0") while register 3002c latches the value stored in register 3002b (which should also be a "0").

The fourth cycle of MUXCLK 44 will now be examined. At the beginning of this cycle, MUXCLK 44 is a "1", the MUXTRI signal 3014 is "1" and the MUXSEL signal 3010 is also a "1". Because of this, register 3000c is driving its contents (which should be a "0") onto the I/O pin of programmable interconnect chip 12 (through multiplexer 3000e and tri-state buffer 3000f). At the end of the clock cycle, when MUXCLK 44 falls, register 3000d latches the value stored in register 3000a (which should be a "1"). At substantially the same time, register 3002d latches the value stored in register 3002a. Because MUXTRI signal 3014 is "1" and MUXSEL signal 3010 is "1", register 3002c drives the I/O pin on programmable logic chip 10, which should be a "0".

As can be seen, if the electrical connections between I/O pins on programmable logic chips 10 and I/O pins programmable interconnect chips 12 maintain high integrity (i.e., no open circuits, low capacitance, etc.) the actual values driven onto the 1/0 will match the expected values. When the electrical connections between I/O pins on programmable logic chips 10 and I/O pins on programmable interconnect chips 12 are poor, the actual value stored in registers will not match the expected value. Thus, OR gates 3004a and 3006a of pattern match circuits 3004 and 3006, respectively, compare the expected values with the actual values. When they match, no error signal is generated. However, when they don't match (for example, if the output of registers 3000a, 3002a ever output a "0"), OR gates 3004a and 3006a will output a "1", which will result in AND gates 3004b and 3006b outputting a "1", which will then store a "1" in register 3004c and or 3006c. The same is true if registers 3000b or 3002b ever output a "1". When this happens, OR gates 3004a and 3006a will output a "1", which will result in AND gates 3004a and 3006a outputting a "1", which will then store a "1" in register 3004c and/or 3006c.

Once the test has been stopped (i.e., when the TRI- signal 3012 goes low), the test program will employ a boundary scan of all tested devices to check the error status of the chip's input/output pins. If a error flag is detected on any tested input/output pin, the software outputs the value and location of the pin to the user. In a presently preferred embodiment registers 3004c and 3006c are read and cleared via a JTAG function in the programmable interconnect chips 12 and programmable logic chips 10.

It should be noted that connections between two programmable interconnect chips 12 (see., e.g., the interconnect between programmable interconnect chips 12 shown in Figs. 18a and 18b) can be tested with the same method described above for testing of connections between programmable logic chips and programmable interconnect chips. Thus, it is not necessary to discuss this method, as would be duplicative.

A second embodiment for performing a dynamic interconnect test will now be discussed with reference to Figs. 30-31. In this second embodiment, the dynamic interconnect test can determine both the test pattern and signal direction for each input/output pin on a device. The system level architecture which dictates the type of connections between chips (i.e. programmable logic chips and programmable interconnect chips) remains the same as described above with respect to the embodiments described with respect to Figs. 28-29. In this embodiment, the software operating the emulation system has the ability to set an input/output pin's test pattern and signal direction, thereby thoroughly testing the interconnection and synchronization between chips with software configured test patterns and direction sets.

Much like the embodiments shown in Figs. 28-29, there are two types of input/output circuits in the modified dynamic interconnect test. The first circuit is set as a driver 4000 while the other circuit is set as a receiver 4002. Drivers 4000 and receivers 4002 are programmed into the programmable logic chips 10 and programmable interconnect chips 12 so that they are in electrical communication with a pin on the chips. In practice, it does not matter which chip is selected as the driver and which chip is selected as the receiver. During a single test run, the input/output driver 4000 outputs the test pattern, which was pre-configured by the emulation software, onto its input/output pin. On the other side of the net, the input/output receiver 4002 is in charge of testing the incoming pattern and flagging an input/output eπor if differences exist between the expected and received data during comparison. Each input/output pin of every programmable logic chip 10 and programmable interconnect chip 12 can be driven by a multiplexed output of individual registers 4000a, 4000b, 4000c, 4000d, 4002a, 4002b, 4002c, 4002d. In the presently preferred embodiment, there are four such individual registers for each pin on each programmable logic chip 10 and programmable interconnect chip 12, although more or less can be used. Each register 4000a-d and 4002a-d are clocked by the MUXCLK 44. As can be seen in the embodiment shown in Fig. 30, registers 4000b, 4000d, 4002b, 4002d are clocked by the falling edge of MUXCLK 44 while registers 4000a, 4000c, 4002a and 4002c are clocked by the rising edge of MUXCLK 44. The outputs of registers 4000a, 4000b, 4000c, 4000d are input to the data inputs of multiplexer 4000e. The outputs of registers 4002a, 4002b, 4002c, 4002d are input to the data inputs of multiplexer 4002e. The select inputs of multiplexers 4000e and 4002e are the SO signal 4014 and the SI signal 4010. The outputs of multiplexers 4000e and 4002e are input to pattern match circuits 4020 and 4022, respectively. In a presently preferred embodiment, each pattern match circuit 4020 and 4022 comprises an EXCLUSIVE-OR gate 4020a and 4022a. EXCLUSIVE-OR gate 4020a receives one of its inputs from the pin in electrical communication with cell 4000 and another of its inputs from the output of multiplexer 4000e. EXCLUSIVE-OR gate 4022a receives one of its inputs from the pin in electrical communication with cell 4002 and another of its inputs from the output of multiplexer 4002e. The output of EXCLUSIVE-OR gate 4020a is input to registers 4020b and 4020c. Registers 4020b and 4020c are arranged in parallel to each other. The output of EXCLUSIVE-OR gate 4022a is input to registers 4022b and 4022c. Registers 4022b and 4022c are arranged in parallel to each other. The outputs of registers 4020b and 4020c are input to an OR gate 4020d. The outputs of registers 4022b and 4022c are input to an OR gate 4020d. The outputs of multiplexers 4000e and 4002e are also input to tri-state buffer 4000f and 4002f, respectively. Tri-state buffers 4000f and 4002f are controlled by the "DIR" signal 4016, which can be seen in Fig. 31. This DIR signal 4016 allows the input/output pin to be tri-stated. If a pin is tri-stated, that pin will be a receiver. If an input/output pin is initially configured to be a driver or receiver, the software must program the input/output pin as such.

Both driver 4000 and receiver 4002 pins have their four individual input/output registers 4000a, 4000b, 4000c, 4000d (driver 4000); and 4002a, 4002b, 4002c, 4002d (receiver 4002) preset with the same defined four-bit test pattern. However, the receiver 4002 output pin is tri-stated by the DIR signal 4016 while the driver 4000 output pin is not. This allows the driver 4000 to propagate its signal pattern to the receiver 4002 for comparison with the receiver's 4002 registered output. The reason this comparison can take place is that the registers 4002a-d on the receiver 4002 are preloaded with the expected value, which is the same as the values loaded into the registers 4000a-d in the driver 4000. Possible states for a driver 4000 input/output pin are: 1) Output Register A; 2)

Output Register B; 3) Output Register C; and 4) Output Register D. Possible States for a "Receiver" 4002 input/output pin are: 1) Input Register A; 2) Input Register B; 3)Input Register C; and 4) Input Register D. These states, i.e., the values of select inputs SO and SI are determined by a "S0/S1" state machine (not shown), which can be a counter that globally switches all the I/O cells and are clocked by the MUXCLK 44 after the test is started by the TRI- signal 4012.

The software has the ability to change the direction of the input/output signal of the programmable logic chips 10 and programmable interconnect chips 12 by inverting the DIR signal 4016. This procedure is executed before the start of each test run. This embodiment of the dynamic interconnect test is allowed to run for a set amount of time which may vary. To start this embodiment of the dynamic interconnect test, the TRI- signal 4012 goes high ("1"), which is seen in Fig. 31. At this time, the registers at the driver pin 4000, registers 4000a-d, are loaded with a pattern of "l"s and "0"s. For purposes of this example, assume that registers 4000a and 4000c are loaded with a "1" and that registers 4000b and 4000d are loaded with a "0". As discussed, the same pattern is loaded into the corresponding registers at the receiver pin 4002, registers 4002a- d. Thus, registers 4002a and 4002c are loaded with a "1" and registers 4002b and 4002d are loaded with a "0". During the first cycle of the MUXCLK 44, the MUXCLK 44, select signal SO 4014 and select signal SI 4010 are "0". Because select signal SO 4014 and select signal SI 4010 are "0", the signals from registers 4000a and 4002a (a "1") are selected by the multiplexers 4000e, 4002e. Because the DIR signal 4016 is a "0", tri-state buffer 4000f drives the value stored by register 4000a onto the pin. If the interconnect between the driver pin 4000 and the receiver pin 4002 has been constructed properly (i.e., low impedance, low capacitance, etc.), this "1" will traverse the interconnect pattern in the printed circuit board and any connectors that form the interconnect path and remain a "1". This "1" is then input to EXCLUSIVE-OR gate 4022a. In addition, the expected value stored by register 4002a, also a "1", is input to EXCLUSIVE-OR gate 4022a. If the expected value (a "1 ") matches the actual value, the EXCLUSIVE-OR gate 4022a will output a "0". The output of EXCLUSIVE-OR gate 4022a is input to registers 4022b and 4022c. Register 4022b is clocked by rising edge of MUXCLK 44 while register 4022c is clocked by the falling edge of MUXCLK 44. At the end of the cycle of MUXCLK 44, MUXCLK 44 rises. When MUXCLK 44 rises, register 4022b loads the value of EXCLUSIVE-OR gate 4022a, which in turn places that signal at the input to OR gate 4022d.

During the next cycle of MUXCLK 44, as seen in Fig. 31, MUXCLK 44 is a "1", select signal SO 4014 is a "0" and select signal SI 4010 rises to a "1". Because the select signal SI 4010 is a "1", the value stored in register 4000b is placed on the I/O pin 4000 by multiplexer 4000e and tri-state driver 4000f. This signal (i.e., the actual value), a "0" if the interconnect has adequate integrity, is then placed on an input to EXCLUSIVE-OR gate 4022a. At the same time, the value stored by register 4002b, the expected value, is placed on the other input to EXCLUSIVE-OR gate 4022a by multiplexer 4002e. If the actual value and the expected value are both a "0", the EXCLUSIVE-OR gate 4022a will output a "0". At the end of this clock cycle, MUXCLK 44 falls, which causes this "0" to be loaded into register 4022c. At this time, assuming that the interconnect has the required integrity, both registers 4022b and 4022c are storing a "0", which are output to the input of OR gate 4022d, resulting in a "0" output. With reference to Fig. 31, a third cycle of the MUXCLK 44 will now be discussed.

During this third cycle, MUXCLK 44 is a "0", select signal SO 4014 is a "1" and select signal SI 4010 is a "0". Because the select signal SO 4014 is a "1", the value stored in register 4000c is placed on the I/O pin 4000 by multiplexer 4000e and tri-state driver 4000f. This signal (i.e., the actual value), a "1" if the interconnect has adequate integrity, is then placed on an input to EXCLUSIVE-OR gate 4022a. At the same time, the value stored by register 4002c, the expected value (a "1"), is placed on the other input to EXCLUSIVE-OR gate 4022a by multiplexer 4002e. If the actual value and the expected value are both a "1", the EXCLUSIVE-OR gate 4022a will output a "0". At the end of this clock cycle, MUXCLK 44 rises, which causes this "0" to be loaded into register 4022b. At this time, assuming that the interconnect has the required integrity, both registers 4022b and 4022c are storing a "0", which are output to the input of OR gate 4022d, resulting in a "0" output.

Finally, a fourth cycle of the MUXCLK 44 will be discussed with reference to Fig. 31. During this fourth cycle of MUXCLK 44, MUXCLK 44 is a "1", select signal SO 4014 is a "1" and select signal SI is a "1". Because both the select signals SO 4014 and SI 4010 are a "1", the value stored in register 4000d is placed on the I/O pin 4000 by multiplexer 4000e and tri-state driver 4000f. This signal (i.e., the actual value), a "0" if the interconnect has adequate integrity, is then placed on an input to EXCLUSIVE-OR gate 4022a. At the same time, the value stored by register 4002d, the expected value (a "0"), is placed on the other input to EXCLUSINE-OR gate 4022a by multiplexer 4002e. If the actual value and the expected value are both a "0", the EXCLUSINE-OR gate 4022a will output a "0". At the end of this clock cycle, MUXCLK 44 falls, which causes this "0" to be loaded into register 4022b. At this time, assuming that the interconnect has the required integrity, both registers 4022b and 4022c are storing a "0", which are output to the input of OR gate 4022d, resulting in a "0" output.

The output Q of flip-flop 4022b is connected to the inverted enable input of flip- flop 4022b. Flip-flops 4022c, 4020b and 4020c have their inverted enable inputs similarly connected to their respective Q outputs. If one of these Q outputs ever becomes a "1" during the test, the flip-flop will subsequently be disabled and will not respond to any further inputs from the EXCLUSIVE OR gate 4022a or 4020a. In this way, even a temporary disruption of the signal path between chips 4000 and 4002 will be captured and will produce an error at the termination of the test.

Clock cycles subsequent to this fourth clock cycle can be evaluated in this fashion by a person of ordinary skill in the art. Therefore, no further discussion will be provided. It can be readily seen from the discussion of this embodiment that if the interconnect between pins 4000 and 4002 has poor integrity, resulting in incoπect values being transfeπed from the driver pin 4002 to the receiver pin 4000, that the EXCLUSIVE- OR gate 4022a will receive an actual value that differs from the expected value. When this happens, the EXCLUSIVE-OR gate 4022a will output a "1", and a "1" will be loaded into one registers 4022b or 4020c. This will result in OR gate 4022c outputting a "1". The outputs of OR gate 4022c are stored on either the programmable interconnect chip 12 or programmable logic chip 10 (the circuitry is not shown. A "1" in this embodiment would be indicative of an error flag. Once the test has been stopped, the test program will employ a boundary scan of all receiver 4002 devices to check the error status of the chip's input/output pins. If an error flag is detected on any tested input/output pin, the software outputs the value and location of the pin to the user.

This embodiment of the dynamic interconnect test of the present invention is stopped synchronously by the falling edge of the TRI- signal 4012. Stopping the dynamic interconnect test prevents false errors caused by one chip expecting a value when another has stopped the test. After the test is stopped and the results studied, the software, at the user's request, may load a different pattern into the driver and receiver chips or change signal directions and rerun the test.

Thus, prefeπed methods and apparatus for emulating, verifying, and analyzing an integrated circuit has been described. Preferred methods of dynamically testing an interconnect structure have also been described. While embodiments and applications of this invention have been shown and described, as would be apparent to those skilled in the art, many more embodiments and applications are possible without departing from the inventive concepts disclosed herein. The invention, therefore is not to be restricted except in the spirit of the appended claims.

Claims

We Claim:

1. A method for dynamically testing interconnections between a first integrated circuit and a second integrated circuit, the first and second integrated circuits having an interconnect placing pins on them in electrical communication, the method comprising: programming a first cell into the first chip such that said first cell is in electrical communication with a pin on the first chip, said first cell comprising a first storage element; programming a second cell into the second chip such that said second cell is in electrical communication a pin on the second chip, said second cell comprising a second storage element; programming a predetermined data value into said first cell; programming a predetermined expected data value into said second cell; transmitting said predetermined data value from said first integrated circuit, through the interconnect, and to said second integrated circuit; comparing said predetermined data value to said predetermined expected value received by said second integrated circuit; and outputting an error flag if said predetermined data value received by said second integrated circuit and said predetermined expected value do not match.

2. The method of claim 1 wherein said first cell comprises a first and a second shift register wherein outputs said first and second shift register are input to a multiplexer.

3. The method of claim 2 wherein a driver receives an output from said multiplexer, said driver controlling whether said output from said multiplexer is placed onto said interconnect.

4. The method of claim 1 wherein said second cell comprises a third and a fourth shift register wherein outputs said third and fourth shift register are input to a multiplexer.

5. The method of claim 4 wherein a driver receives an output from said multiplexer, said driver controlling whether said output from said multiplexer is placed onto said interconnect.

6. The method of claim 1 wherein said first cell comprises a plurality of registers for storing said predetermined data values, said plurality of registers in electrical communication with a multiplexer that selects which predetermined data value is placed onto said interconnect.

7. The method of claim 6 wherein said second cell comprises a plurality of registers for storing said predetermined expected values, said plurality of registers in electrical communication with a multiplexer that selects which predetermined expected value is compared to said predetermined data value.

8. The method of claim 1 wherein said steps are performed in seriatim.

9. The method of claim 1 wherein said interconnect comprises a trace of a printed circuit board and contacts having pins of said first and second integrated circuits installed thereon.

10. The method of claim 1 wherein said interconnect comprises multiple traces of a printed circuit board, vias between said traces, and contacts having pins of said first and said second integrated circuits installed thereon.

11. The method of claim 1 wherein said interconnect comprises at least one trace of a first printed circuit board, vias between said traces, electrically conductive connectors for interconnecting a second printed circuit board to said first printed circuit board, and contacts having pins of said first and said second integrated circuits installed thereon.

12. An apparatus for testing electrical integrity of interconnect between a first integrated circuit and a second integrated circuit, said first integrated circuit comprising a first pin, said second integrated circuit comprising a second pin, said first pin and said second pin in electrical communication with each other through an interconnect, the apparatus comprising: a first cell in electrical communication with said first pin on said first integrated circuit, said first cell comprising a first pattern match circuit, said first cell storing a predetermined data value; and a second cell in electrical communication with said second pin on said second integrated circuit, said second cell comprising a second pattern match circuit, said second cell storing a predetermined expected value.

13. The apparatus of claim 12 wherein said first cell comprises a first shift register and a second shift register, said first shift register comprised of a first register and a second register, said second shift register comprised of a third register and a fourth register, said first cell further comprising a first multiplexer and a first driver, said first register in electrical communication with said first pattern match circuit, said second register in electrical communication with said first multiplexer, said third register in electrical communication with said first pattern match circuit, said fourth register in electrical communication with said first multiplexer.

14. The apparatus of claim 13 wherein said second cell comprises a third shift register and a fourth shift register, said third shift register comprised of a fifth register and a sixth register, said fourth shift register comprised of a seventh register and an eighth register, said second cell further comprising a second multiplexer and a second driver, said fifth register in electrical communication with said second pattern match circuit, said sixth register in electrical commumcation with said second multiplexer, said seventh register in electrical communication with said second pattern match circuit, said eighth register in electrical communication with said second multiplexer.

15. The apparatus of claim 14 wherein said first cell comprises a plurality of first registers, said plurality of first registers outputting to a first multiplexer, said first multiplexer outputting to said first pattern match circuit and to a first driver, said first driver outputting said predetermined data value to said first pin on said first integrated circuit, said first pin in electrical communication with said second pin on said second integrated circuit though a interconnect structure, the interconnect structure being tested for integrity.

16. The apparatus of claim 14 wherein said second cell comprises a plurality of second registers, said plurality of second registers outputting to a second multiplexer, said second multiplexer outputting to said second pattern match circuit, said second pattern match circuit comparing said predetermined expected value with said predetermined data value.

17. The apparatus of claim 12 wherein said first integrated circuit and said second integrated circuit are installed on a printed circuit board.

18. The apparatus of claim 17 wherein said interconnect comprises a trace of said printed circuit board and contacts having pins of said first and second integrated circuits installed thereon

19. The apparatus of claim 12 wherein said first integrated circuit is installed on a first printed circuit board and said second integrated circuit is installed on a second printed circuit board.

20. The apparatus of claim 19 wherein said interconnect comprises at least one trace of said first printed circuit board, at least one trace on said second printed circuit board, and a connector for placing said at least one trace of said first printed circuit board and said at least one trace on said second printed circuit board in electrical communication.

21. The method of claim 12 wherein said interconnect comprises a trace of a printed circuit board and contacts having pins of said first and second integrated circuits installed thereon.

22. The method of claim 12 wherein said interconnect comprises multiple traces of a printed circuit board, vias between said traces, and contacts having pins of said first and said second integrated circuits installed thereon.

23. The method of claim 12 wherein said interconnect comprises at least one trace of a printed circuit board, vias between said traces, electrically conductive connectors for interconnecting printed circuit boards together, and contacts having pins of said first and said second integrated circuits installed thereon.