Pulses and photo-conducting based antennas are well suited for many Terahertz (THz) applications such as high speed wireless communication systems and imaging applications. However, some issues on the attenuation of free space propagation need to be addressed well to produce high accuracy for both indoor and outdoor THz applications. In the previous research, we have studied the matching layer (ML) effect in 1 THz resonant frequency of a planar bow-tie on high dielectric hemispherical lens antenna. It provides a high gain and efficiency performances, but also has an issue of high side lobe level (SLL) which make it inconvenient for proper practical applications. In this paper, we study the effect of cascaded MLs on the double-crossed planar bow-tie antenna combined with the dielectric hemispherical lens to reduce the SLL and increase the gain and efficiency. From the simulation results, the gain and efficiency can be increased up to 33.63 dB and 84.6%, respectively at four cascaded ML. SLL can be improved equally at around -12 dB for both E-and H-Plane, respectively.