the code is of lexical analyzer.It is the first stage of compilation of code.It generates tokens of the source code.




File list:
lab02sc
......\lab02sc
......\.......\bin
......\.......\...\Debug
......\.......\...\.....\Database1.mdf
......\.......\...\.....\Database1_log.ldf
......\.......\...\.....\lab02sc.exe
......\.......\...\.....\lab02sc.pdb
......\.......\...\.....\lab02sc.vshost.exe
......\.......\...\.....\lab02sc.vshost.exe.manifest
......\.......\...\.....\tokens.txt
......\.......\obj
......\.......\...\x86
......\.......\...\...\Debug
......\.......\...\...\.....\TempPE
......\.......\...\...\.....\DesignTimeResolveAssemblyReferences.cache
......\.......\...\...\.....\DesignTimeResolveAssemblyReferencesInput.cache
......\.......\...\...\.....\GenerateResource.read.1.tlog
......\.......\...\...\.....\GenerateResource.write.1.tlog
......\.......\...\...\.....\lab02sc.csproj.FileListAbsolute.txt
......\.......\...\...\.....\lab02sc.exe
......\.......\...\...\.....\lab02sc.Form1.resources
......\.......\...\...\.....\lab02sc.pdb
......\.......\...\...\.....\lab02sc.Properties.Resources.resources
......\.......\...\...\.....\ResolveAssemblyReference.cache
......\.......\Properties
......\.......\..........\AssemblyInfo.cs
......\.......\..........\Resources.Designer.cs
......\.......\..........\Resources.resx
......\.......\..........\Settings.Designer.cs
......\.......\..........\Settings.settings
......\.......\Database1.mdf
......\.......\Database1_log.LDF
......\.......\Form1.cs
......\.......\Form1.Designer.cs
......\.......\Form1.resx
......\.......\lab02sc.csproj
......\.......\lab02sc.csproj.user
......\.......\Program.cs
......\lab02sc.sln
......\lab02sc.suo