[BPDU] To understand BPDU Filtering an BPDU Guard

Quote from http://www.cisco.com/en/US/docs/switches/lan/catalyst3560/software/release/12.2_55_se/configuration/guide/swstpopt.html#wp1046220

Understanding BPDU Guard

The BPDU guard feature can be globally enabled on the switch or can be enabled per port, but the feature operates with some differences.

At the global level, you enable BPDU guard on Port Fast-enabled ports by using the spanning-tree portfast bpduguard default global configuration command. Spanning tree shuts down ports that are in a Port Fast-operational state if any BPDU is received on them. In a valid configuration, Port Fast-enabled ports do not receive BPDUs. Receiving a BPDU on a Port Fast-enabled port means an invalid configuration, such as the connection of an unauthorized device, and the BPDU guard feature puts the port in the error-disabled state. When this happens, the switch shuts down the entire port on which the violation occurred.

To prevent the port from shutting down, you can use the errdisable detect cause bpduguard shutdown vlan global configuration command to shut down just the offending VLAN on the port where the violation occurred.

At the interface level, you enable BPDU guard on any port by using the spanning-tree bpduguard enable interface configuration command without also enabling the Port Fast feature. When the port receives a BPDU, it is put in the error-disabled state.

The BPDU guard feature provides a secure response to invalid configurations because you must manually put the interface back in service. Use the BPDU guard feature in a service-provider network to prevent an access port from participating in the spanning tree.

Understanding BPDU Filtering

The BPDU filtering feature can be globally enabled on the switch or can be enabled per interface, but the feature operates with some differences.

At the global level, you can enable BPDU filtering on Port Fast-enabled interfaces by using the spanning-tree portfast bpdufilter default global configuration command. This command prevents interfaces that are in a Port Fast-operational state from sending or receiving BPDUs. The interfaces still send a few BPDUs at link-up before the switch begins to filter outbound BPDUs. You should globally enable BPDU filtering on a switch so that hosts connected to these interfaces do not receive BPDUs. If a BPDU is received on a Port Fast-enabled interface, the interface loses its Port Fast-operational status, and BPDU filtering is disabled.

At the interface level, you can enable BPDU filtering on any interface by using the spanning-tree bpdufilter enable interface configuration command without also enabling the Port Fast feature. This command prevents the interface from sending or receiving BPDUs.

[Google Chart] Some examples of using Google Chart API in Python

Here are some example codes of using Google Chart APIs written in Python that I wrote several years ago. And some output image for reference.

• To generate multi-line chart:

def createMultiLineChart(rows, max_value):
urls = "http://chart.apis.google.com/chart?" + \
"chs=" + str(300+24*rows.__len__()) + "x200" + \
"&chd=t:" + ",".join([str(i[1]) for i in rows]) + "|" + ",".join([str(i[2]) for i in rows]) + \
"&cht=lc" + \
"&chls=2,1,0|2,1,0" + \
"&chco=0000ff,ff0000" + \
"&chtt=SMT%20Scrap%20Rate" + \
"&chxt=x,y" + \
"&chg=20,20" + \
"&chds=0," + str(max_value * 1.4) + \
"&chxl=0:|" + "|".join([str(i[0]) for i in rows]) + "|1:|" + "|".join(
[str(i * max_value * 1.4 / 10.0) + '%' for i in range(0,11)]) + \
"&chdl=Day%20S/R(%)|Night%20S/R(%)" + \
"&chm=s,0000ff,0,-1,8|s,ff0000,1,-1,8|N*f3*%,0000ff,0,-1,10|N*f3*%,ff0000,1,-1,10"
return urls

• To generate multi-line chart:

def createLineChart(rows, max_value):
urls = "http://chart.apis.google.com/chart?" + \
"chs=" + str(300+24*rows.__len__()) + "x200" + \
"&chd=t:" + ",".join([str(i[1]) for i in rows]) + \
"&cht=lc" + \
"&chls=2,1,0" + \
"&chco=8080ff" + \
"&chtt=SMT%20Scrap%20Rate" + \
"&chxt=x,y" + \
"&chg=20,20" + \
"&chds=0," + str(max_value * 1.4) + \
"&chxl=0:|" + "|".join([str(i[0]) for i in rows]) + "|1:|" + "|".join(
[str(i * max_value * 1.4 / 10.0) + '%' for i in range(0,11)]) +\
"&chdl=S/R(%)" + \
"&chm=s,80C65A,0,-1,10|N*f3*%,8080ff,0,-1,10"
return urls
P.S: It is almost the same as multi-line chart so that I don't provide the image.

• To generate bar chart:

def createBarChart(rows, max_value):
urls = "http://chart.apis.google.com/chart?" + \
"chs=" + str(300+24*rows.__len__()) + "x200" + \
"&chd=t:" + ",".join([str(i[1]) for i in rows]) + \
"&cht=bvg" + \
"&chco=1d89f9,c6d9fd" + \
"&chtt=SMT%20Scrap%20Rate" + \
"&chxt=x,y" + \
"&chg=20,20" + \
"&chds=0," + str(max_value * 1.4) + \
"&chxl=0:|" + "|".join([str(i[0]) for i in rows]) + "|1:|" + "|".join(
[str(i * max_value * 1.4 / 10.0) + '%' for i in range(0,11)]) +\
"&chdl=S/R(%)" + \
"&chbh=14,9,15"
#"&chf=bg,s,ffffef"
return urls

• To generate pie chart:

def createPieChart(rows, legend):
urls = "|".join([i[0] for i in rows])
urls = urls.replace(' ','_')
urls=urls.encode('utf8')
urls=urllib.quote(urls,'&=')
return "http://chart.apis.google.com/chart?" + \
"chs=600x150" + \
"&chd=t:" + ",".join([str(i[1]) for i in rows]) + \
"&cht=p3" + \
"&chtt=" + legend + \
"&chl=" + urls

[Linux Command] Redirect stderr to stdout and output to terminal and log into file at the same time

If you want to redirect stderr to stdout, append this at your command: 2>&1 , and also for outputting to terminal and logging into file you should use tee.
Both together would look like this:
$ yourcommand 2>&1 | tee yourlogfile.log

[Floodlight] A simle note from Floodlight dev discussion

For some kind of the reasons, I stopped tracking what's going on Floodlight for a while. I post my previous notes about Floodlight and OpenFlow from Floodlight dev discussion, and hope it is beneficial for those who are still working on it.

• Floodlight by default gets full packets from switch
  • OFPT_SET_CONFIG
  
  
• GreenMST module for Floodlight
  • GreenMST is a module used to build the Minimum Spanning Tree of an OpenFlow network, thus avoiding brodcast storm, using looped topologies with the LearningSwitch module and switches not supporting the Spanning Tree Protocol.
  • http://github.com/LucaPrete/GreenMST
  
  
• Wildcard Matching on network address
  • OFMatch mTo = new OFMatch();
    mTo.fromString("dl_type=0x800,nw_dst=224.128.0.0/9");
    System.out.println(mTo.toString()); // This prints nw_dst as 224.128.0.0/9
    System.out.println(mTo.getNetworkDestinationMaskLen()); //This prints destination mask length as 9
    But when I do dump-flows in the switch, it doesn't show any mask. It simply gives nw_dst as 224.128.0.0.
     
• Push static flows based on ingress ports
  • your forwarding would not work any more.  Reason is any packet coming to that port is forced out the same port, making LLDP no longer workable.  LLDP is needed for floodlight to learn topology and route/forward packets.
  
  
• BDDP Topology Discovery
  • In BSN BDDP and BSNPROBE types were defined.  BDDP is used in TopologyDiscovery to detect non-OpenFlow broadcast domains.  BSNPROBE is not used in Floodlight now.
  
  
• Disabling Flooding for a Switch Port
  • OFPortMod p = (OFPortMod) floodlightprovider.
    getOFMessageFactory().getMessage(OFType.PORT_MOD);
    p.setPortNumber((short) 4); // or your port number
    p.setConfig(config); // you have to enter the proper Integer to disable the port (see OpenFlow doc)
  • The setting is related with OFPPC_NO_FLOOD
  
  
• No NAT in Floodlight now
• Creating static flows in Floodlight
  • https://groups.google.com/a/openflowhub.org/forum/?fromgroups=#!searchin/floodlight-dev/kevin$20pietrow/floodlight-dev/lx5JXyDXumg/eAy1FNrFSm0J

• Northbound API
  • Right now all the decisions are made logically (load balancer, firewall) so they will never have to travel to other computers. As far as the ordering in which these are executed you can enforce some special ordering by returning something in the isCallbackOrderingPostreq methods supplied by the IFloodlightmodule interface. For instance in the firewall module we have...
    
    
    @Override
    public boolean isCallbackOrderingPostreq(OFType type, String name) {
        return (type.equals(OFType.PACKET_IN) && name.equals("forwarding"));
    }
    
    
    This says that the module has a post requirement and forces Packet_IN messages to be passed on to the forwarding module. This is an example of how you would enforce an ordering. You can probably find something similar in the loadbalancing module.
• Virtual Network
• multiple links between two controller islands (which is the case for fat tree topologies) are not supported by Floodlight, at least for now. See Supported Topologies for details.

[SPC] SPC Demo

Here is a SPC System Demo Video that is related with the previous article: [SPC] A simple SPC system introduction

Check it out:
http://www.youtube.com/watch?v=XLRKj2mgnEA

[SPC] A simple SPC system introduction

SPC System

Introduction

• Statistic Process Control (SPC) has adopted and widely used in many industries, such as, IC foundry, automobile, and so on. It provides the function to monitor the process(manufacturing) capacity and check if the monitor data violates SPC Rules. The following content explains how we build up the system architecture and what the basic items are inside this system.

SPC Chart Setting

• Table: t1twsql1.mistw.dbo.SPC_CHART_SETTING
• This table contains all the SPC Chart Setting Data and is critical for message sending and receiving.
• Column definition:
• 5 categories(Category1, Category2, Category3, Category4, Category5) are combined with comma, for instance, "T3,37XX,LINEA,N/A,N/A".
• u_spec_limit: Upper SPEC Limit
• l_spec_limit: Lower SPEC Limit
• spc_rules: How many SPC Rules are adopted? For example => 2⁰ + 2¹ + 2 ² + 2³ = 1 + 2 + 4 + 8 = 15 = Rule1 + Rule2 + Rule3 + Rule4
• sampling_rule: Only support SamplingRuleAvg?
• sample_number: How many data will become a point value
• data_type: Double or String
• is_enabled: Y/N
• need_to_reset: Y/N
• xbar: Default X Bar.
• dev: Default Std. Dev.
• owner
• memo
• last_alarm_time
• last_updated_time

SPC Rules

• One point beyond the 3σ control limit
• 2 out of 3 consecutive points plot outside of the 2σ control limit
• 4 out of 5 consecutive points plot outside of the 1σ control limit
• 9 consecutive points on the same side of the centerline
• 6 consecutive points increase or decrease
• consecutive points oscillate up and down
• consecutive points inside of the 1σ control limit

So, when there is any applied SPC Rule that is violated, the SPC Server will send SPC Alarm Email to specific user directly. The following is the example of the email:

SPC Server

• The main purpose of SPC Server is to monitor the process data and check the SPC Rules. Once it violates rules, the alarm email will send to related persons directly. But, before sending alarm email, there are a bunch of things that need to do. The following content will introduce the detail information about SPC Server.
• What does the SPC Chart look like in our SPC system?
• Our SPC Chart will display the latest 24 points data, 3σ control limit lines, and 2 SPEC limit lines as follows:

• Multi-threading in SPC Server
• For the purpose of showing dynamic SPC Chart image and updating the SPC info into database, there are several threads doing their jobs to keep SPC Server work well as follows:
• GUI: This is the main thread. It controls the GUI drawing and event handling with JFrame application.
• JMS Receiver: We adopt ActiveMQ as JMS Provider and its API to achieving the message receiving and sending. When SPC Server starts, it will generate a JMS Receiver that we have implemented for SPC purpose and this Receiver will listen and watch out if there is any message coming.
• SPC Chart Drawer: This heavy loading job to draw SPC Chart image is done by the Class: SPCCanvas. It refreshes the current SPC Chart image that includes to draw upper and low SPEC limits, 3σ control limits, xbar line, 24 data points, and some data labels near lines and points in every 100 millisecond. Without it, the SPC Chart image won't show smoothly.
• DB Sync: In order to know the current SPC info, for instance, xbar, std. dev., and the current 24 data points, last updated time, and last alarm time. The Class: SPCSync is to sync this information into database in every minute. And we can use the web application to query these information.

• SPC Image Synchronization:

As mentioned below, SPC Server has multi-threads running when it starts so that it will encounter the resource that could be accessed or updated by 2 or more threads at the same time. It's the issue of resource synchronization. In our case, we have to avoid drawing image when SPC Server is adding a new point into its SPC Chart at the same time. In other words, we don't want to see that the SPC Chart image is not complete or not correct. This situation also will affect the correction of SPC Alarm Email. Our solution is to use Semaphore which is based on Lock object to achieve our goal. The more detail is in the following image: 

• SPC Server Data Process Flow
• When the number of the point in a SPC Chart reach 24, SPC Server will start to draw the Chart Image.
• When data message comes, SPC Server will follow up this process flow to deal with SPC calculation and applying SPC Rules.

• SPC Server Data Structure:
• The data structure is very important because it controls and contains all the point data and SPC setting in the memory so that we can lookup and operate data quickly. The main data structure is as follows:

• SPC Server Configuration
• DataSource?_PROD.properties
• This properties file is as same as we use in web application
• activemq_PubSub.config
• This config file is about the ActiveMQ (JMS Provider) setting

§  mq.url=tcp://localhost:61616

§  mq.messagetype=Topic

§  mq.subject=testtopic

§  mq.username=

§  mq.password=

• log4j.properties

o    log4j.logger.SPCSERVER=ALL, SERVERFileAppender, consoleAppender

o     

o    #Console Log

o    log4j.appender.consoleAppender=org.apache.log4j.ConsoleAppender

o    log4j.appender.consoleAppender.layout=org.apache.log4j.PatternLayout

o    log4j.appender.consoleAppender.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %m%n

o     

o    #SPC Server File Log

o    log4j.appender.SERVERFileAppender=org.apache.log4j.DailyRollingFileAppender

o    log4j.appender.SERVERFileAppender.DatePattern='.'yyyy-MM-dd

o    log4j.appender.SERVERFileAppender.layout=org.apache.log4j.PatternLayout

o    log4j.appender.SERVERFileAppender.layout.ConversionPattern=%d{yy-MM-dd HH:mm:ss:SSS} [%c] %p :  %m%n

o    log4j.appender.SERVERFileAppender.File=C:\\log\\spc\\spcserver.log

SPC Client

• SPC Server needs to be fed by data message and SPC Client is playing the role to provide the messaging source. So far we only implement a client program for fetching the columns in TblFinal? table. Different message source could need a different client to deal with because how to generate the data message and what the format of data message are key points. For this case, the the foramt of chart name has 4 categories and 1 data vlaue: Product Name, Test Type, Station, Column Name, and coming with a colon and a data value.
• For instance, nuvi 3790 Software Version 2.60,A,T3_3001FT07,SNR:44.5
• SPC Client program will query data from TblFinal? in SPC database(MySQL) and is based on chart name format to generate the data message and send to the topic in JMS Provider.
• SPC Client Configuration
• activemq_client.config

o    mq.url=tcp://localhost:61616

o    mq.messagetype=Topic

o    mq.subject=testtopic

o    mq.username=

o    mq.password=

• spc_client_datasource.config

o    DS_MYSQL.SPC_URL=jdbc:mysql://10.124.0.132:3306/SPC

o    DS_MYSQL.SPC_USER=xxxx

o    DS_MYSQL.SPC_PASSWD=xxxx

o    DS_MYSQL.SPC_DRIVER=com.mysql.jdbc.Driver

o    DS_MYSQL.SPC_CHARENCODING=big5

o    DS_MYSQL.SPC_DBTYPE=MYSQL

• spc_data_mapper.config

o    #Data Mapper

o    spc.client.main=TBLFINALDataMapper

o    tblfinal=SNR

SPC System Web Application

• This web application provides all the parameter setting management and query function in SPC.
• spc_client_query
• Provide the basic qeury function of SPC setting and current SPC info.

• Provide the SPC Chart setting for TblFinal?.

• Provide the Alarm Email setting with SPC chart.