We describe a secure communication scheme that uses the random fluctuation of the natural environment of communication channels. Only the transmitter and the receiver share the communication channel characteristics. From reciprocity between a transmitter and a receiver, it is possible for them to share one-time information of their fluctuating channel. This can provide a secret key agreement scheme without key management and key distribution processes. In this paper, we propose a new secret key generation and agreement scheme that uses the fluctuation of channel characteristics with an electronically steerable parasitic array radiator (ESPAR) antenna. This antenna, which has been proposed and prototyped, is a smart antenna designed for consumers. Using the beam-forming technique of the ESPAR antenna, we can increase the fluctuation of the channel characteristics. From experimental results, we conclude that the proposed scheme has the ability to generate secret keys from the received signal strength indicator (RSSI) profile with sufficient independence.